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(57) Traditionally, the operator must determine the 
type of an image displayed on a screen and manually 
select one of various kinds of effect processing for the 
type of the image. As is generally known, however, such 
operations have a lack of accuracy and are difficult for 
an untrained user to carry out. In addition, the image is 
not correctly compensated for color slippages over the 
entire gradation range. Furthermore, in the case of im- 
age data including an abnormal element other than just 
a color slippage, the image can not be corrected with a 
high degree of efficiency. 

At a step SI 02, a sample-count distribution of im- 
age data is found for each color component by applying 
a thinning technique on samples. AtastepSIIB, a judg- 
ment as to whether or not analogy exists among the 
sample-count distributions of the color components is 
formed. A low degree of analogy is regarded as an in- 
dicator which suggests that characteristics recognized 
from the sample-count distributions shall naturally be 
made uniform among the color components. In this 
case, the characteristics are compensated for a color 
slippage included therein by correcting an offset, putting 
an emphasis on the contrast and correcting the bright- 
ness at steps S204 to 8216 in order to produce a well 
pitched and good image from the image data with poor 
color reproducibility. In addition, since the compensation 
and correction work is automated, even an untrained us- 
er is capable of correcting the balance of color with ease. 
Furthermore, at a step S205, an offset quantity reflecting 
a degree of analogy is calculated for use in the compen- 
sation of the characteristics for a color slippage. 
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Description 

Technical Field to which the Invention Belongs 

In general, the present invention relates to an innage processing apparatus, an image processing nnethod and a 
medium for storing an image-processing control program. In particular, the present invention relates to an image 
processing apparatus and an image processing method for correcting the balance of color as well as relates to a 
medium for storing an image-processing control program for the image processing apparatus and the image processing 
method. 



Related Background Art 

Traditionally, correction of the balance of color in many cases means correction of the so-called color fog or the 
like. That is, correction of the balance of color implies processing to correct a color slippage observed in equipment 
such as an image inputting apparatus. 

In a digital still camera, for example, image data is output as a gradation-color-specitication data of the RGB (red, 
green and blue) colors. In this case, data with the so-called color slippage due to characteristics ot a lens or a CCD 
device employed in the digital still camera is also observed. An example of the color slippage is a state in which a 
particular color such as the red color is emphasized more than the color of the real object of observation. 

When it is desired lo make some compensations of image data for a color slippage thereof by using the conventional 
image processing apparatus, the data is read by an image processing program and an operator weakens the component 
value of an emphasized color by carrying out a predetermined operation on a trial-and-error basis. 

However, the conventional method for correcting a color slippage has the following problems. 

I n the first place, carried out by an operator manually on a trial-and-error basis, the correction has a lack of accuracy. 
For an untrained operator, the correction is difficult to do. 

In the second place, since only predetermined component values are increased or decreased in a uniform manner, 
in some cases, the correction can not be said to be done for all gradations. 

Furthermore, it the data contains abnormalities other than just the color slippage, the correction can not be said 
to be effective. 

In addition, it is basically impossible to form a judgment as to whether gradation-color-specification data lor each 
component representing the color of every picture element is correct or not without comparing the color with a standard 
one. Considering the fact that there are possibly some cases in which it is a matter of course that a component is 
emphasized by rather an external factor, we can not help saying that it is extremely difficult to automatically form a 
judgment as to whether or not a color slippage exists. 



Disclosure of the Invention 

Addressing the problems described above, it is thus an object of the present invention to provide an image process- 
ing apparatus and an image processing method capable of automating correction of color reproducibility ot a color with 
an abnormality such as the so-called color slippage and also capable of correcting the overall the balance of color, as 
well as a medium for storing an image-processing control program for the image processing apparatus and the image 
processing method. 

In the image processing apparatus provided by the present invention, predetermined transformation is carried out 
for converting an input into an output with the balance of color thereof corrected in accordance with an associative 
relation between the input and the output. To put it in detail, the image processing apparatus inputs each component 
value of image data which represents an image as a set of picture elements forming a dot matrix by using gradation- 
color-specification data comprising all but equal color components. The image processing apparatus then carries out 
the predetermined transformation processing on the input component values. To be even more specific, the Image 
processing apparatus employs a characteristic uniforming means whereby distribution of gradation-color-specification 
data is found for each color component in order to identify variations among color components and the identified slip- 
pages are used as a basis for making the characteristics of color components uniform. 

In addition, in the image processing method provided by the present invention, the predetermined transformation 
is carried out for converting an input into an output with the balance of color thereof corrected in accordance with an 
associative relation between the input and the output. To put it in detail, the image processing method comprises the 
step of inputting each component value of image data which represents an image as a set of picture elements forming 
a dot matrix by using gradation-color-specification data comprising all but equal color components, the step of carrying 
out the predetermined transformation processing on the input component values, the step of finding distribution of 
gradation-color-specification data for each color component in order to identify slippages among color components 
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and the step of using identified slippages as a basis for making the characteristics of color components uniform. 

Furthermore, an image processing program stored by using a computer in a medium provided by the present 
invention is used to carry out the predetermined transformation for converting an input into an output with the balance 
of color thereof corrected in accordance with an associative relation between the input and the output. To put it in detail, 

5 the image processing program is used to input each component value of image data which represents an image as a 
set of picture elements forming a dot matrix by using gradation-cotor-specification data comprising all but equal color 
components. The image processing program is then used to carry out the predetermined transformation processing 
on the input component values. To be even more specific, the image processing program is used to find distribution 
of gradation-color-specification data for each color component in order to identify slippages among color components 

10 and to utilize the identified slippages as a basis for making the characteristics of color components uniform. 

With the present invention having a configuration described above, if there is image data which is produced as 
gradation -color-specification comprising all but equal color components to represent an image as a set of picture ele- 
ments forming a dot matrix, each component value of the image data is input and the predetermined transformation 
processing is then carried out on the input component values. That is to say, the predetermined transformation is 

75 carried out for converting the input into an output with the balance of color thereof corrected in accordance with an 
associative relation between the input and the output. In this process, the charactehstic uniforming rineans is used for 
finding a distribution of gradatton-color-specification data for each color component in order to identify slippages among 
color components and for utilizing the identified slippages as a basis for making the characteristics of the color com- 
ponents uniform. 

20 Let a digital still camera be taken as an example. The traditional correction of the balance of color comprises the 

steps of forming a judgment as to whether or not a component value of each color is emphasized and adjusting the 
transformation characteristic of each color component for each picture element to produce a balance of color According 
to the present invention, on the other hand, a distribution of gradation-color-specification data is found for each color 
component and characteristics of color components are identified from the separated distributions of the gradation- 

2S color-specification data. An attempt is then made to make the identified charactenstics uniform. That is, it has become 
obvious that, with the characteristics of the distributions of the gradation-color-specification data made uniform for all 
color components, as an image, a well pitched image having no color slippages can be obtained without regard to the 
substance of the image. The operation to make the characteristic uniforms is based on the distributions of gradation- 
color-specification data It should be noted, however, that the characteristic uniforming is not to be construed as char- 
ge acteristic uniforming in a strict sense. Instead, the characteristic uniforming can be interpreted as an effort to at least 
set a trend toward uniformity to a certain degree. 

Thus, by embracing the concept of making the distributions of components uniform in accordance with the present 
invention, the formation of a judgment on a color slippage which is basically difficult to judge can be automated, allowing 
the balance of color to be adjusted more easily In this case, the scope of the present invention is not necessarily limited 

35 to a physically tangible apparatus. Instead, the present invention is also applicable to a method to automate the for- 
mation of such a judgment and to adjust the balance of color That is, the present invention can also be applied to a 
case in which such a method is implemented by a computer 

In this sense, any distribution is useful as long as the state of the distribution can be recognized for each color 
component. A variety of statistical techniques including a sample-count distribution can also serve as such a tool. For 

40 example, secondary data derived from primary data can even be used as well. Examples of secondary data are a 
mode, a median and a standard deviation extracted from a sample-count distribution. In this case, a sample-count 
distribution has a merit that the processing thereof is easy to carry out and can be made simple. 

In order to obtain accurate statistical values for all picture elements in a process to find a sample-count distribution 
described above, however, it takes much labor 

45 For this reason, it is thus another object of the present invention to reduce the amount of labor to obtain statistical 

values of a sample-count distribution. 

In order to achieve the other object of the present invention described above, a characteristic uniforming means 
employed in the image processing apparatus provided by the present invention is designed into a configuration wherein 
only picture elements approximated by the gradation-color-specification data are treated as objects for tabulating a 

50 sample-count distribution. 

Originally, a color abnormality of an image that can be recognized by a human being by merely looking at the 
image as a color slippage is an abnormality caused by a color appearing on a portion of the image that should have 
no color That is, by looking at a red color only, it is impossible to form a judgment as to whether or not a color slippage 
exists if the original color is not known. Thus, it is not always necessary to treat all picture elements equally. That is, 

55 recognition of variations in characteristic for only picture elements with no color can be said to be an effective way to 
study balance among colors. For this reason, the characteristic uniforming means forms a judgment as to whether or 
not pieces of gradation-color-specification data of color components resemble each other for all picture elements. Only 
if they resemble each other, are they used as objects for finding sample-count distributions. Characteristics are then 
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uniformed by using the sample-count distributions obtained under such a condition as a base. 

The judgment as to whether or not pieces of gradation-color-specification data of color components resemble each 
other can be formed by finding maximum and minimum values of the data and evaluating differences in maximum and 
minimum among the pieces of gradation-color-specification data. It is quite within the bounds of possibility that data 
exhibiting extreme values is saturated data which can be excluded from the process to make characteristics uniform. 

In this way, according to the present invention, only picture elements approximated by the gradation-color-speci- 
fication data are picked up to be used in formation of a judgment on characteristics. Accordingly, the present invention 
is also effective for recognition of variations in characteristic. 

On the other hand, there are a variety of concrete methods for making characteristics uniform. As a matter of fact, 
it is still another object of the present invention to provide a concrete method for making characteristics uniform. 

In order to achieve the other object of the present invention described above, a characteristic uniforming means 
employed in the image processing apparatus provided by the present invention is designed into a configuration wherein 
a judgment on a characteristic is formed from a predetermined position on a sample-count distribution and the mag- 
nitudes of offsets for slippages among color components are found to be used in correction of color-component values 
?5 in order to make the characteristics uniform. 

In the present invention with a configuration described above, in addition to a process to find a sample-count 
distribution for each color component, positions on a sample-count distributions such as upper and lower ends, an 
average, a median and a mode are also recognized as well, allowing the characteristic of each color component to be 
recognized from the sample-count distribution for the color component and the identified positions on the sampte-count 
dislribulion. Since the recognized characteristic can be considered to be a characleristic wherein slippages among 
color components result in a real color slippage, the magnitudes of offsets for the slippages can be found to be used 
in the correction of color-component values. 

Thus, according to the present invention, since slippages at the positions of a sample-count distribution are taken 
into account, the magnitudes of offsets among the color components can be evaluated relatively with ease. 

In this case, slippages among color components are found by treating the upper and lower ends at the extreme 
positions of the range of the sample-count distribution as a characteristic of the sampte-count distribution. 

If individual sample-count distributions are observed, an extremely large number of different distributions are iden- 
tified. Nevertheless, even for a diversity of sample-count distributions, the upper-end and lower-end positions thereof 
can be recognized easily in a uniform manner, allowing a characteristic to be acquired with ease. 

As another example, the characteristic uniforming means can also be designed into a configuration wherein a 
position approximately at the center of a sample-count distribution is judged as the characteristic of the sample-count 
distribution. 

In this case, slippages among color components are found by treating an average value, a median or a mode 
located approximately at the center position of a sample-count distribution as the characteristic of the sampte-count 
55 distribution. 

Similarly, even for a diversity of sample-count distributions, positions thereof such as an average value, a median 
or a mode located approximately at the center of a sample-count distribution can be recognized easily in a uniform 
manner, allowing a characteristic to be acquired with ease. In addition, since slippages at positions with a high distri- 
bution density are taken into account, the number of errors generated in the correction of the slippages as a whole is 
40 smalL 

In most of ordinary images, by the way, in spite of the fact that there are differences in absolute value among color 
components, there are no such big differences in frequency-distribution spreading among them. For this reason, it can 
be said to be rather natural to have uniformed degrees of frequency-distribution spreading among the color components 
and, in most cases, non-uniformed degrees of frequency-distribution spreading among the color components are there- 
^5 fore not natural. 

For this reason, it Is thus a further object of the present invention to solve the unnaturalness of the degrees of 
spreading of the sample-count distributions. 

In order to achieve the further object of the present invention described above, the characteristic uniforming means 
employed in the image processing apparatus provided by the present invention is designed into a configuration wherein 
50 the states of sample-count-distribution spreading of the color components are made all but uniform. 

In the present invention with a configuration described above, the states of sample-count-distribution spreading 
of all color components are recognized and made all but uniform. 

As a result, according to the present invention, since the states of sample-count-distribution spreading of the color 
components are made all but uniform, colors can be generated with a high degree of efficiency for each color component 
from a number of gradations which are effective for the color component but not effectively utilized, allowing a well- 
pitched image to be reproduced. 

Here, the concept of the frequency-distribution spreading can be interpreted in a variety of ways, making it unnec- 
essary to limit the concept to a particular way of interpretation. 
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As an example, the characteristic uniforming means can be designed into a configuration wherein the right and 
left ends of the sample-count distribution are shifted outward in order to widen the spreading within an effective gra- 
dation range. 

In the present invention with a configuration described above, since the width of a sample-count distribution having 

5 a mountain-like shape can be recognized by finding the right and left ends of the bottom of the mountain-like shape, 
the sample-count distribution is transformed into another one by widening the width within an eflective gradation range. 
If the width of the sample-count distribution is stretched only over a portion of the effective gradation range, for example, 
the image represented by the sample-count distribution can be said to have a weak contrast. In this case, the spreading 
of the sample-count distribution of each color component is enhanced, that is, the distribution is widened, so that the 

10 width thereof occupies the entire effective gradation range in order to make the characteristics uniform. In this context, 
a characteristic implies the width of a sample-count distribution. It should be noted that the width of a sample-count 
distribution does not necessarily mean the actual width thereof. The width of a sample-count distribution may Imply a 
net width obtained by cutting off portions of the sample-count distribution each having a predetermined amount at the 
right and left ends thereof in order to discard sub-ranges that can cause errors. 

fs As a result, according to the present invention, the spreading of only the remaining part of a sample-count distri- 

bution, on which a judgment can be formed with ease, is widened by shifting the right and left ends outward, giving 
rise to a configuration allowing a judgment to be formed easily. 

As another example, the characteristic uniforming means can be designed into a configuration wherein a targe 
number of gradations are allocated to a range with a high distribution density while only a small number of gradations 

20 are allocated to a range with low distribution density in accordance with the degree of spreading of the sample-count 
distribution. 

In the present invention with a configuration described above, the characteristic uniforming means finds the degree 
of spreading of a sample-count distribution for each color component. The degree of spreading is then used as a basis 
for allocating a large number of gradations to a range with a high distribution density and allocating only a small number 

2S of gradations to a range with low distribution density. Much like the width of a sample-count distribution, the concept 
of frequency-distribution spreading corresponds to the way the sample-count distribution is dispersed. The concept of 
frequency-distribution spreading can thus correspond to a mathematical quantity such as the standard deviation, the 
variance or the statistical sharpness. When the degrees of spreading each representing the characteristic of a sample- 
count distribution are made close to each other in an attempt to make the characteristics of color components uniform, 

30 the sample-count distribution of each color component is transformed into one with a portion having a high distribution 
density is widened to cover an allowable range so that the coincidence among the degrees of spreading of the sample- 
count distributions, which exhibited slippages among color components, can be verified and, at the same time, in the 
resulting sample-count distribution of each color component, the effective range Is utilized as much as possible with 
no distribution concentrated only on a portion of the distribution range. As a result, an emphasis is put on the contrast 

35 as a whole. It Is needless to say that the degree of spreading can be a mathematical quantity other than the standard 
deviation, the variance or the sharpness. In addition, computation In a strict sense is not required for either mathematical 
quantity, allowing the processing to be made simple. 

As a result, according to the present invention, since the concept of frequency-distribution spreading based on a 
mathematical technique is embraced, an accurate judgment can be formed. 

40 On the other hand, observation of each color component may indicate that balance of brightness is not established. 

For this reason, it is thus a still further object of the present invention to establish the balance of brightness among 
color components. 

In order to achieve the still further object of the present Invention described above, the characteristic uniforming 
means employed in the image processing apparatus is designed into a configuration wherein degrees of brightness 
45 of color components are made uniform by manipulating sample-count distributions thereof. 

In the present invention with a configuration described above, since non-uniform degrees of brightness among 
color components may appear as color slippages, the characteristic uniforming means makes the degrees of brightness 
of the color components uniform by manipulating sample-count distributions thereof. For example, by positioning a 
sample-count distribution as a whole on the bright side, the image appears bright. By positioning a sample-count 
50 distribution as a whole on the dark side, on the other hand, the image appears dark. 

As a result, according to the present invention, by making the degrees of brightness uniform among color compo- 
nents, it is possible to avoid a color slippage which results in only a particular highlighted color component. 

It is needless to say that the technique of forming a judgment on the whole brightness can be modified properly, 
tn addition, a variety of techniques can be adopted properly as a method of correction for making an image either 
5S brighter or darker. 

As an example of correcting the brightness, the characteristic uniforming means can be designed into a configu- 
ration wherein a gradation located approximately at the center position of the sample-count distribution is compared 
with a predetermined gradation in order to form a judgment as to whether the image is bright or dark. 
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In the present invention with a configuration described above, the characteristic unifornning means compares a 
gradation located approximately at the center position of the sample-count distribution with a predetermined gradation 
in an effective gradation range in order to form a judgment as to whether the image is bright or dark. 

For example, a median gradation obtained during a process to create a sample-count distribution satisfies condi- 
5 tions of being regarded as a gradation located approximately at the center position of the sample-count distribution. 
By determining whether such a median gradation is higher or lower than a center gradation of the entire gradation 
range, it is possible to form a judgment as to whether the degree of brightness is high or low. 

As a result, according to the present invention, a gradation located approximately at the center position of a sample- 
count distribution can be used as a criterion to form a judgment as to whether the degree of brightness is high or low 
10 with ease. 

As an example of an implementation technique for making degrees of brightness uniform, the characteristic uni- 
forming means described above can also be designed Into a configuration wherein degrees of brightness of an Image 
are made uniform among color components by y correction based on a result of a judgment on the brightness of the 
image. 

In the present invention with a configuration described above, after a judgment on the brightness of an image has 
been formed by using a variety of techniques, degrees of brightness of the image are made uniform among color 
components by y correction based on a resu It of the judgment. In the case of an image which appears dark, for example, 
the image as a whole is made brighter by y correction with the y parameter set a value smaller than unity(y < 1 ) to shift 
the median gradation to a position closer to the center of the entire gradation range. In the case of an image which 
^0 appears bright, on the other hand, the image as a whole is made darker by y correction with the y parameter set at a 
value greater than unity (y > 1 ) to shift the median gradation to a position closer to the enter of the entire gradation range. 

As a result, according to the present invention, degrees of brightness are made uniform by changing the brightness 
through y correction, making the configuration simple by virtue of the wide use of they correction. 

By the way, in some cases, it is rather characteristics of sample-count distributions not matching each other that 
arc natural. In the case of a scene In the evening, for example, it is not unnatural to have only a color pertaining to the 
red color group. In such a case, it is rather unnatural to uniform characteristics judged from sample-count distributions 
for color components. 

For this reason, it Is thus a still further object of the present invention not to make characteristics uniform in an 
unnatural way. 

30 In order to achieve the still further object of the present invention described above, the characteristic uniforming 

means employed In the image processing apparatus Is designed into a configuration including a correction control 
means whereby the degree of analogy among sample-count distributions of gradation -color-specification data of color 
components is found and, If the degree of analogy is found low. the color balance is not corrected. 

In the present Invention with a configuration described above, the correction control means finds the degree of 
35 analogy among sample-count distributions of gradation-color-specification data of color components and, if the degree 
of analogy is found low, the color balance is not corrected. 

In the present invention with a configuration described above, first of all, the correction control means forms a 
judgment on the degree of analogy among sample-count distributions of gradation-color-specification data of color 
components. In the case of a scene obtained in the evening with the color system comprising the red (R), the green 
40 (G) and the blue (B), sampled-count distributions in favor of only the red color are obtained. The sampled-count dis- 
tributions for the blue and green colors are reduced considerably. In such a case. It is rather natural to see the non- 
uniform characteristics of the sample-count distributions and an extremely low degree of analogy among them. There- 
fore, It is not necessary to make the characteristics of the sample-count distributions uniform. When the color compo- 
nents appear as values in close proximity to an average, on the other hand, the degree of analogy among the sample- 
rs count distributions thereof is judged to be high. In such a case, by making the characteristics of the sample-count 
distributions match each other, the magnitude of a systematic error inherent in the Image Inputting apparatus can be 
reduced. 

As a result, according to the present Invention, since characteristics are not made uniform deliberately for a low 
degree of analogy among sample-count distributions, it is possible to prevent an unnatural picture from being generated 
50 as a result of making characteristics uniform In a case where a slippage In the balance of color is natural. 

When forming a judgment on a degree of analogy among sample-count distributions, it is not always necessary 
to individually compare the distributions for all gradations. 

For this reason, it Is thus a still further object of the present invention to simplify the way of obtaining a statistical 
value representing a sample-count distribution. 
55 In order to achieve the still further object of the present invention described above, the correction control means 

employed in the Image processing apparatus Is designed into a configuration wherein the gradation range that the 
gradation-color-speclflcation data can have is divided into a plurality of zones and a judgment on a degree of analogy 
among color components is formed by comparing portions of a sample-count distribution In the zones with those of 
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other distributions in the corresponding zones. 

In the present invention with a configuration described above, the gradation range that the gradation-color-spec- 
ification data can have is divided into a plurality of zones and a judgment on a degree of analogy among color com- 
ponents is formed by comparing portions of a sample-count distribution in the zones with those of other distributions 
5 in the corresponding zones. 

As a result, according to the present embodiment, since a judgment on a degree of analogy among color compo- 
nents is formed by comparing portions of a sample-count distribution in the zones with those of other distributions in 
the corresponding zones, the amount of labor to form a judgment is reduced in comparison with the formation of such 
a judgment by comparing sample counts for each gradation over the gradation range. 
10 On the other hand, a variety of techniques for forming a judgment on a degree of analogy among sample-count 

distributions can be adopted. Forthis reason, it isthus a still further object of the present invention to provide a technique 
for forming a judgment on a degree of analogy among sample-count distributions with ease. 

In order to achieve the still further object of the present invention described above, the correction control means 
employed in the image processing apparatus is designed into a configuration wherein formation of a judgment on a 
15 degree of analogy among sample-count distributions of color components is based on inner products of characteristic 
vectors each representing one of the sample-count distributions. To put it in detail, the sum of sample counts in each 
of the zones of a sample-count distribution is used as a member of the characteristic vector representing the sample- 
count distribution. 

It is easy to check a correlation among sample-count distributions of color components by using such inner prod- 

20 ucls. In the technique provided by the present invention for forming a judgment on a degree of analogy among sample- 
count distributions, inner products of characteristic vectors each representing a correlation among color components 
are found by treating the sum of sample counts in each of the zones of a sample-count distribution as a member of 
the characteristic vector representing the sample-count distribution. A highest degree of analogy is indicated by an 
inner product having a value of unity. For a low degree of analogy, on the other hand, the value of the inner product 

25 approaches a zero. In treating the sum of sample counts in a zone of a sample-count distribution as a member of the 
characteristic vector representing the sample-count distribution, it is not always necessary to take sample-count sums 
in all the zones as members. Only sample-count sums in some selected zones can serve as members 

As a result, according to the present invention, since formation of a judgment on a degree of analogy among 
sample-count distributions is based on inner products of characteristic vectors representing the sample-count distri- 

30 butions, such a judgment can be formed with ease 

When making a decision as to whether or not to make characteristics uniform in the case of a low degree of analogy, 
the decision does not have to be based on selection of one two choices obtained as a result of comparing a degree 
of analogy with a threshold value. This is because it is quite within the bounds of possibility that the two choices have 
a discontinuous value on a boundary thereof, making it difficult to select one of them. 

35 For this reason, it is thus a still further object of the present invention to provide a technique for making a decision 

as to whether or not to make characteristics uniform whereby the decision is not based on selection of one of two 
choices. 

In order to achieve the still further object described above, the image processing apparatus provided by the present 
invention is designed into a configuration wherein an effective value is provided for making a decision as to whether 

40 or not to make characteristics uniform. In the configuration, the correction control means is in essence capable of 
making a decision as to whether or not to make characteristics uniform by varying the effective value and making the 
effective value continuously variable. 

In the present invention with a configuration described above, the image processing apparatus provides an effective 
value used in making a decision as to whether or not to make characteristics uniform and the correction control means 

45 jn essence makes a decision as to whether or not to implement the correction by varying the effective value. A window 
function is effective for controlling such a decision making mechanism. To put It in more concrete terms, the effective 
value is multiplied by a window function, the value of which is set at unity when it Is desired to implement the correction 
or at a zero when it is desired not to implement the correction. 

Assume that the effective value is in the range 0 to 1 . In a region where the effective value changes from 0 to 1 

50 or from 1 to 0, the change may be non-continuous, often causing the outcome of a judgment on the degree of analogy 
to subtly vary in accordance with how pieces of gradation -color-specification data are put to use. As a result, a judgment 
on even on the very same image may produce two outcomes opposite to each other. As a measure taken for countering 
such a case, the effective value is made continuously variable over such a region by multiplying it by a window function. 
It is needless to say that the window function can have a variety of forms. In some cases, the window function can 

55 exhibit an exceptional behavior such as making the effective value effective in a region with a low degree of analogy. 
In other cases, the window function can display just an opposite behavior. Of course, the effective value cited above 
is a value contributing much to the correction. Examples of the effective value are a correction quantity, a compensation 
quantity and an offset quantity. On the other hand, the value of the window function can be a variable used in a process 
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of manipulating the effective value. 

As a result, according to the present invention, it is possible to make discontinuity difficult to appear in a result of 
the image processing by making the effective value used in uniforming characteristics continuously variable. 

Efforts to make characteristics uniform based on sample-count distributions found for color components have been 
5 explained so far. However, a more efficient technique for recognizing the characteristics of the sample-count distribu- 
tions remains to be identified. For this reason, it is thus a still further object of the present invention to recognize 
characteristics in an efficient way. 

In order to achieve the still further object of the present invention described above, the characteristic uniforming 
means employed in the image processing apparatus is designed into a configuration including a color-slippage com- 
10 puting means for finding a color slippage of gradation -color-specification data from slippages in value among color 
components in low-brightness and high-brightness zones of the gradation-color-specification data. 

It is not easy to recognize which color is emphasized in the gradation-color-specification data described above. 
This is because, in the case of an image composed ot picture elements arranged to form a matrix, the image data of 
each picture elements has a component value corresponding to the color of the real image so that, by merely looking 
^5 at each component value, it is impossible to form a judgment as to whether or not a color slippage from the real image 
exists. 

In the present invention with a configuration described above, on the other hand, the color-slippage computing 
means finds color-component values in low-brightness and high-brightness zones of gradation-color-speciftcation data 
on the premise that the gradation-color-specification data is composed ot all but equal color components. In low-bright- 

20 ness and high-brightness zones of the gradation-color-specification data which mean the black and white colors re- 
spectively, the color components should have an equal value so that, in many cases, color components having values 
different from each other in these zones can be seen as an evidence of a color slippage. For this reason, the values 
of color components in these zones are compared with each other and a slippage in value among color components 
can be used to form a judgment that there is a color slippage in the gradation-color-specification data. 

2^ As a result, according to the present invention, a color slippage can be found automatically by recognizing a slip- 

page in value among color components in a zone that should naturally have an equal value for all the color components. 

Here, gradation-color-specification data composed of all but equal color components is taken as an object of 
processing. The approximate equality allows the utilization of a property of the gradation-color-specification data ex- 
hibiting that the color components have an equal value in the low-brightness and high-brightness zones. As a result, 

30 any gradation -color-specification data can be used as an object of processing as long as the data has such a property 
This is because, even if there is no readily available equality relation, such a property allows transition to an equal- 
value environment through predetermined transformation operations. Assume, for example, that gradation-color-spec- 
ification data of an L*a*b color system is supplied. By performing color transformation of the supplied data into one 
with color components having an equal relation such as the RGB color components, the technique described above 

35 can be applied to the gradation-color-specification data. It should be noted that, in general, the amount of color-trans- 
formation processing is large. In the case of the present invention, however, since the processing is limited to some 
particular zones, that is, the low-brightness and high-brightness zones described above, the amount of the processing 
can be decreased, allowing the processing to be carried out by using only few resources. 

In addition, the processing of a color slippage can be basically positioned at any stage in the flow of the image 

40 processing. That is to say, the color-slippage processing can be carried out after other transformation processing, or 
prior to the other transformation processing so that the other processing can be carried out after elimination of color 
slippages. It is needless to say that the latter sequence is preferred. 

The low-brightness or a high-brightness zone is the so-called colorless zone, a zone in which color components 
have an equal value. Thus, a zone in which color components have an equal value can be changed properly For 

4S example, the range of gradation-color-specification data of image data is sufficiently narrower than what the range 
should naturally be. The gradation-color-specification data can undergo transformation processing if the range includes 
a low-brightness or a high-brightness zone. It is needles to say that, since the existence of a color slippage is set forth 
as a premise, the word 'equal' used in the statement "the color components have an equal value** is not to be construed 
to imply the word "coincident" in a strict sense. 

50 As described above, in the low-brightness and high-brightness zones, color components have an equal value. For 

this reason described, it is thus a still further object of the present invention to find a color slippage with a high degree 
of accuracy. 

In order to achieve the still further object of the present invention described above, the color-slippage computing 
means employed in the image processing apparatus provided by the present invention is designed into a configuration 
55 wherein a color slippage can be found with a high degree of accuracy. 

In general, it is the high-brightness zone that is prone to the problem of a color slippage. This is because, in spite 
of the fact that a color slippage exists in a low-brightness zone, a change in color caused by a difference in value 
between color components in the low-brightness zone is hardly seen by the eyes of a human being. Thus, by forming 
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a judgment on a color shift cause by a difference in value annong color component only in the high-brightness zone, it 
is possible to recognize a color slippage only in a range that can be seen with ease by the eyes of a human being as 
a problem caused by the color slippage. 

Asa result, according to the present invention, by treating only the high-brightness zone as an object of observation. 
s the amount of processing can be reduced and, at the same time, only a color slippage in a more practical zone can 
be recognized. 

As for differences in value among color components in a zone having a predetermined degree of brightness, it will 
be satisfactory if a color slippage can be found with a high degree of accuracy by recognizing the trend of variations 
in value for each color components in a range of brightness having a certain width in a broad sense. 
10 For the reason described above, it is thus a still further object of the present invention to find a color slippage with 

ease. 

In order to achieve the still further object of the present invention described above, the color-slippage computing 
means employed in the image processing apparatus provided by the present invention is designed into a configuration 
wherein a judgment on the existence of a color slippage is formed by finding a slippage in value among color compo- 
15 nents for the same degree of brightness. 

To put it in detail, for image data with a certain degree of brightness in a high-brightness zone, if an observation 
of component-color values thereof indicates that the component-color values are not equal to each other, the difference 
in value among the color components is regarded as a color slippage. By the same token, for image data with a certain 
degree of brightness in a low-brightness zone, if an observation of component-color values thereof indicates that the 
20 component-color values are not equal to each other, the difference in value among the color components is regarded 
as a color slippage. 

As a result, according to the present embodiment, since a judgment on a color slippage is formed by finding a 
slippage in value among color components for the same degree of brightness, the processing is simple in comparison 
with processing in which a range of degrees of brightness are treated as an object of the processing. 

25 In addition, it is a still further object of the present invention to pursue a higher degree of universality. 

In order to achieve the still further object of the present invention described above, the color-siippage computing 
means employed in the image processing apparatus provided by the present invention is designed into a configuration 
wherein, for each color component, a representative value of gradation-color-specification data corresponding to a 
degree of brightness, for which a color slippage is to be recognized, is found and a difference between the representative 

30 value and the degree of brightness is judged to be a color slippage. 

Also in this case, much like the configuration of the present invention described above, a color slippage for each 
color component at a certain degree of brightness is recognized by finding a representative value of each color com- 
ponent. In case there are some pieces of gradation-color-specification data corresponding to the degree of brightness, 
a value that can be said to be the representative value such as an average value representing the pieces of gradation- 

35 color-specification data is calculated. In the case of gradation-color-specification data composed of all but equal color 
components, if a maximum value exists in a range of values that color components can have, the degree of brightness 
for the maximum value is also highest and, if a minimum value exists in a range of values that color components can 
have, the degree of brightness for the minimum value is also lowest. If a color slippage does not exist in the low- 
brightness and high-brightness zone, a coinciding relation is seen in brightness values among the color components. 

40 Thus, by using a difference between the representative value and the brightness value, a judgment on a universal 
color slippage can be formed. 

As a result, according to the present invention, by finding a representative value of gradation -color-specification 
data corresponding to a certain degree of brightness for each color component, the reliability of the data can be en- 
hanced and, in addition, since a difference between the representative value and the degree of brightness is judged 

■^5 to be a color shift, it is possible to carry out extremely concise processing. 

Even If only the low-brightness or high-brightness zone is taken into consideration, at a minimum or maximum 
degree of brightness among an entire range of values that the brightness can have, the values tor all color components 
are equal to a minimum or maximum sample count, most likely indicating a circumstance as if no color slippage were 
generated. 

50 For the reason described above, it is thus a still further object of the present invention to detect a color slippage 

with a high degree of reliability. 

In order to achieve the still further object of the present invention described above, the color-slippage computing 
means employed in the image processing apparatus provided by the present invention is designed into a configuration 
wherein a brightness distribution of gradation-color-specification data is tabulated, an upper pseudo end is determined 

55 at a distance from the upper true end of the reproducible range of brightness so that the sum of sample counts between 
the upper pseudo end and the upper true end is equal to a predetermined fraction of the total number of all samples, 
a lower pseudo end is likewise determined at a distance from the lower true end of the reproducible range of brightness 
so that the sum of sample counts between the lower pseudo end and the tower true end is equal to the predetermined 
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fraction of the total number of all samples and slippages of color-component values at the upper and lower pseudo 
ends are found. 

It is naturally desired to find a slippage in value among color components at the highest or lowest degree of bright- 
ness of the gradation-color-specification data. In the real state of the found brightness distribution, however sample 
5 counts at each of the true ends is most likely an extreme value generated by a cause such as noise. In this case, the 
sample counts at the true ends are equal to the maximum or minimum sample counts which is uniform for all color 
components, making it perhaps impossible to form a judgment on a slippage. Thus, by using a statistical technique, 
upper and lower pseudo ends on a tabulated brightness distribution are determined at a distance from the upper and 
lower true ends of the distribution range respectively so that the sum of sample counts between the upper pseudo and 
10 true ends and that between the lower pseudo and lower true ends are each equal to a predetermined fraction of the 
total number of all samples in order to provide sample counts for comparison among color components in a true sense 
at the pseudo ends by exclusion of a sample count caused by noise or the like. Accordingly by finding color slippages 
at the pseudo ends from color-component values, effects of noise and the like can be removed. 

As a result, according to the present invention, with such a degree of brightness at which a color slippage is found, 
15 a sample count generated by a cause such as noise can be excluded by a statistical technique, allowing a color slippage 
to be found with an even higher degree of accuracy. 

It is needless to say that, after a judgment on the existence of a color slippage in gradation-color-specification data 
has been formed in this way, the color-component values of the gradation-color-specification data are corrected in 
order to absorb the recognized color slippage. In a concrete implementation of the technique for correcting color- 
^0 component values, the color-component values are corrected individually. As an alternative, a new filter is created to 
be used in the correction. As another alternative, on the premise that another color transformation is to be carried out, 
color-component values are corrected by changing the contents of a table used in the other color transformation or 
parameters used in interpolation processing. 

In the correction of color-component values for a recognized color slippage described above, a recognized color 
25 slippage does not necessarily match a correction quantity, a quantity by which a color-component value should bo 
corrected. 

For example, assume that the recognized color slippage has a value of +20. In this case, theoretically the color 
slippage can be eliminated by adding a product of a parameter of -1 and the color slippage to the color-component 
value to be corrected. In reality, however, the correction of the color-component value is carried out by using a com- 
30 pressed parameter of typically -0.5 instead of the theoretical parameter -1 . 

For the reason described above, it is thus a still further object of the present invention to obtain an even better 
result of correction based on a color slippage. 

In order to achieve the still further object of the present invention described above, the characteristic uniforming 
means employed in the image processing apparatus provided by the present invention is designed into a configuration 
including a color-slippage correcting means whereby a compressed recognized color slippage is used for correcting 
a color-component value. 

A color slippage used in the correction of a color-component value is a color slippage recognized in a low-brightness 
or high-brightness zone as described above. In some cases, such a color slippage can not be said to be an appropriate 
correction quantity for each gradation. In order to solve this problem, a color slippage recognized at a predetermined 
gradation is adapted to other gradation values by adopting a linear technique. It is then an adapted color slippage that 
is used in the correction of a color-component value. 

Assume, for example, that a color slippage -i-a and a color slippage +b are recognized at a degree of brightness 
L in the low-brightness zone and at a degree of brightness H in the high-brightness zone respectively. In this case, at 
a gradation value (L + X) at a distance X from the degree of brightness L, a correction quantity to be used in the 
correction of a color-component value is expressed by X * (b - a) / (H - L) + a Here, the color slippage is subject to 
linear interpolation. It should be noted that better correction can be applied to the color slippage. For example, color 
slippages at a plurality of points are found to be used in non-linear processing to compute a correction value. 

As a result, according to the present invention, by applying a compressed color slippage in correction of a color- 
component value instead of using a detected color slippage in the correction as it is, the result of the correction in a 
sense of feeling is improved. In addition, since a color-component value is corrected by using a correction quantity 
adapted to each gradation, a color slippage can be absorbed with a high degree of accuracy. 

By the way, according to one aspect of the present invention, such an image processing apparatus is implemented 
by an embodiment which exists as stand-alone equipment while, according to another aspect of the present invention, 
the image processing apparatus is implemented by an embodiment incorporated in equipment. In addition, the image 
55 processing apparatus can also be implemented by software, hardware or a combination of software and hardware 
which can each be properly modified. 

Assume, as an example, a printer driver wherein image datacomposedof a dot matrix as represented by gradation- 
color-specification data comprising all but equal color components is transformed into image data adjusted to printing 
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ink to be printed on a predetermined color printer. Also in the configuration of the printer driver, a statistical quantity 
representing a sample-count distribution of the gradation-color-specification data is found for each color component, 
characteristics of the color components are uniformed by using the statistical quantity as a base and image data made 
uniform in this way is printed. 

5 As described above, the printer driver transforms image data supplied thereto into image data adjusted to printing 

ink to be printed on a color printer. At that time, a sample-count distribution of the image data is found for each color 
component and the transformation is carried out so as to uniform characteristics identified from the sample-count 
distributions among the color components prior to the printing. To put it in detail, the sample-count distributions found 
for the color components are compared with each other and then corrected so as to make the sample-count distributions 

10 uniform. As a result, the balance of color as a whole is adjusted and, at the same time, good component colors are 
generated from individual picture elements. 

In addition, the printer driver for transforming image data supplied thereto as gradation <;olor-specificat ion data 
composed of all but equal color components into Image data adjusted to printing ink to be printed on a predetermined 
color printer can be designed Into a configuration wherein a color slippage of the gradation-color-specification data Is 

75 found from slippages in value among color components in low-brightness and high-brightness zones of the image data 
supplied thereto and color-component values of the gradation-color-specitication data are individually corrected to 
absorb the recognized color slippage. 

That is, the printer driver transforms image data supplied thereto into image data adjusted to printing ink to be 
printed on a color printer. At that time, a color slippage is found in the so-called colorless portions such as the low- 

20 brighlness and high-brighlness zones. Then, color-component values of the gradation-color-specification data are in- 
dividually corrected so as to absorb the recognized color slippage prior to the printing. 

If the concept of the present invention Is Implemented concretely by software executed in an Image processing 
apparatus, it is a matter of course that the software is most likely made available for use in a recording medium for 
storing the software, 

2^ It is needless to say that the recording medium can be a magnetic recording medium or an optical magnetic re- 

cording medium. Even recording medium to be developed in the future can be considered as the recording medium 
in entirely the same way as the magnetic recording medium or the optical magnetic recording medium. In addition, 
there Is no room at all for a doubt as to the equivalence of a copy -level product such as a primary copy product or a 
secondary copy product to the recording medium. Furthermore, the present Invention will have the same effects even 

30 if applied to an application wherein the software is transmitted to the Image processing apparatus through a commu- 
nication line by a software supplying apparatus functioning on the software supplying side. 

In addition, the concept of the present invention can be Implemented partially by software and partially by hardware 
to give exactly the same effects. According to one aspect of the present invention, some of the software is embedded 
In the hardware while the rest is stored in a recording medium to be loaded into the hardware whenever necessary 

35 Furthermore, It is needless to say that the present Invention can also be applied to a wide range of image processing 
apparatuses including a color facsimile machine, a color copy machine, a color scanner, a digital still camera and a 
digital video camera. 
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Brief Description of the Drawings 



Fig. 1 is a block diagram showing an image processing system employing an image processing apparatus as 
implemented by the first embodiment of the present Invention; 

Fig. 2 is a block diagram showing a typical hardware configuration of the image processing apparatus shown in 
Fig. 1 in concrete terms; 

^5 Fig. 3 is a block diagram showing an application of an image processing apparatus provided by the present inven- 

tion in a simple and plain manner; 

Fig. 4 is a block diagram showing another application of an image processing apparatus provided by the present 
invention In a simple and plain manner; 

Fig. 5 Is a flowchart showing pieces of processing carried out by a picture-element-count-distribution detecting 
50 means and an analogy-degree judging means employed in the image processing apparatus provided by the 

present invention; 

Fig. 6 is a flowchart showing pieces of processing which are carried out by an offset correcting means^ a contrast 
correcting means and a brightness correcting means employed in the image processing apparatus provided by 
the present invention; 
55 Fig. 7 is a diagram showing coordinates in an image to be transformed; 

Fig. 8 is a diagram showing a sampling period; 
Fig. 9 is a diagram showing sampled-picture-element counts; 

Fig. 10 is diagrams each showing a relation between an image to be transformed and picture elements thereof to 
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be sampled; 

Fig. 11 is a diagram showing an array of variables for holding picture-element counts used for forming picture- 
element-count distributions; 

Fig. 1 2 is a flowchart representing a thinning process to extract gray picture elements; 
Fig. 1 3 is a diagram showing a black-and-white image; 

Fig. 14 is a diagram showing a picture-element-count distribution of a black-and-white image; 

Fig. 15 is a diagram showing picture-element-count distributions of color components of natural and unnatural 

pictures; 

Fig. 16 is a diagram showing an image having a frame on the circumference thereof; 

Fig. 17 is a diagram showing picture-element-count distributions of color components of an image having a frame 
on the circumference thereof; 

Fig. 1 8 is a diagram showing a picture-element-count distribution including end portions obtained from end process- 
ing of the distribution; 

Fig. 19 is a diagram showing a method for extracting members of a characteristic vector from a picture-element- 
count distribution represented by the vector; 

Fig. 20 is a diagram showing a linear relation between RGB color components of a photographic object and the 
RGB components of image data representing the photographic object; 

Fig. 21 is a diagram showing a transformation table used for carrying out transformation of image data based on 
picture-element-count distributions; 

Fig. 22 is a diagram showing an enlarged gradation range and a full gradation range of picture-elemenl-counl 
distributions; 

Fig. 23 is diagrams each showing a case in which limits are imposed on the enlargement factor of the contrast of 
an image; 

Fig. 24 is a diagram showing picture-element-count distributions of color components required for uniforming the 
brightness; 

Fig. 25 is a diagram showing transformation relations between the input and the output of y correction; 

Fig. 26 is a diagram showing an S curve representing a relation between the input and the output of transformation 

processing to put an emphasis on the contrast of an Image; 

Fig. 27 is a diagram showing a transformation relation obtained by interpolation based on specific points of trans- 



Fig. 28 is a flowchart representing part of processing to correct the contrast and the brightness of an image based 
on a relation represented by an S curve; 

Fig. 29 is a diagram showing ways in which an image processing program is transferred from a recording medium 
used for storing the program to a hard disk; 

Fig. 30 is a diagram showing a graph representing a state of change in value of a window function used for adjusting 
an offset quantity; 

Fig. 31 is a flowchart of an image processing program used for adjusting an offset quantity by using a window 
function; 

Fig. 32 is a diagram showing a graph representing another state of change in value of a window function used for 
adjusting an offset quantity; 

Fig. 33 is a block diagram showing an image processing system employing an image processing apparatus as 
implemented by another embodiment of the present Invention; 

Fig. 34 Is a block diagram of a digital still camera, an application In which the image processing apparatus provided 
by the present invention is used; 

Fig. 35 Is a diagram showing the configuration of a printer driver, another application in which the image processing 
apparatus provided by the present invention Is used; 

Fig. 36 is a diagram showing an order in which pieces of processing are carried out in the image processing 
apparatus provided by the present invention, 

Fig. 37 is a diagram showing another order in which pieces of processing are carried out in the image processing 
apparatus provided by the present Invention; 

Fig. 38 is a flowchart representing processing to correct a color slippage by the Image processing apparatus pro- 
vided by the present invention; 

Fig. 39 is a graph showing a characteristic of Image data; 

Fig. 40 is a graph showing a state of slippages among color-component values at a high-brightness zone; 
Fig. 41 is a graph showing a state of slippages among color-component values at a low-brightness zone; and 
Fig. 42 is a diagram showing a range of processing brightness obtained for a picture-element-count distribution. 
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Description of Special Embodiments 

The present invention will become more apparent from a careful study of the following detailed description of some 
preferred embodiments with reference to the accompanying diagrams. 



First Embodiment 

A first embodiment is described by referring to accompanying diagrams as follows. 

Fig. 1 is a block diagram showing an image processing system implemented by the first embodiment of the present 

10 invention and Fig. 2 is a block diagram showing a typical hardware configuration in concrete terms. 

As shown in the figures, an image inputting apparatus 10 picks up an image, outputting image data to an image 
processing apparatus 20. The image processing apparatus 20 carries out image processing on the image data such 
as uniforming characteristics thereof, outputting results of the image processing to an image outputting apparatus 30. 
The image outputting apparatus 30 displays an image with the contrast thereof emphasized. 

fs Examples of the image inputting apparatus 10 are a scanner 11, a digital still camera 12 and a video camera 14 

whereas typical implementations of the image processing apparatus 20 include a computer system comprising a com- 
puter 21 and a hard disk 22. Examples of the image outputting apparatus 30 are a printer 31 and a display unit 32. Of 
course, the image outputting apparatus 30 can also be implemented by equipment such as a color copy machine or 
a color facsimile machine in addition to the examples cited above. 

^0 In the present image processing system, an attempt is made to correct an image with poor color reproducibility 

caused mainly by a color slippage. Thus, data produced by the image inputting apparatus 10 such as image data 
obtained as a result of picking up an image by a scanner 11, image data obtained as a result of picking up an image 
by a digital still camera 12 or dynamic-image data picked up by a video camera 14 is data to be processed. Such data 
is supplied by the image inputting apparatus 10 to a computer system which functions as the image processing appa- 

25 ratus 20. It should be noted that, in the case of dynamic-image data supplied by a video camera 14, the processing 
speed of the computer system may not be high enough for keeping up with variations of the dynamic image. In such 
a case, an initial condition required for the processing time is set for each scene. By carrying out only image transfor- 
mation for each frame with the same condition setting in an operation to pick up a dynamic image, the speed problem 
can thus be solved. 

30 The image processing apparatus 20 comprises at least a picture-element count-distribution detecting means for 

detecting a picture-element -count distribution of each color component, an analogy-degree judging means forjudging 
the degree of analogy among picture-element-count distributions of color components, an offset correcting means for 
identifying slippages among color components from the picture-element-count distributions in order to make the color 
components uniform, a contrast correcting means for identifying slippages in degree of contrast among color compo- 

35 nents from the picture-element-count distributions in order to make the contrasts of the color components uniform and 
a brightness correcting means for identifying slippages in brightness among color components from the picture-ele- 
ment-count distributions in order to make the brightness amounts of the color components uniform. It is needless to 
say that, in addition to the means described above, the image processing apparatus 20 may include a color changing 
means for correcting a difference in color caused by a difference in machine type and a resolution changing means 

40 tor changing the resolution in accordance with the type of the machine. In this example, the computer 21 uses com- 
ponents such a RAM unit in execution of image processing programs stored in an internal ROM unit and the hard disk 
22. In addition to the internal ROM unit and the hard disk 22, these programs can of course be stored in portable 
storage media such as a flexible disk 41 and a CD-ROM 42 as well as other kinds of storage medium shown in Fig. 
29. As shown in Fig. 29, these programs can be installed in a hard disk 43, provided in an IC card having a ROM unit 

45 44 or a RAM unit 45 therein or stored in a storage medium connected to the information processing apparatus 20 
through a communication line 46a and communication equipment such as a modem 46b. In the case of the commu- 
nication line 46a, the other end of the communication line 46a is connected to a file server 46c for supplying certain 
software. 

As an execution result of the image processing program, well pitched image data with corrected color reproducibility 
50 to be described later is obtained. The image data obtained in this way is used as a basis for printing the image on the 
printer 31 serving as the image outputting apparatus 30 or displaying the image on the display unit 32 which is also 
used as the image outputting apparatus 30. It should be noted that, to put it in concrete terms, the image data is 
gradation data comprising 256 gradations for each of the RGB (red, green and blue) colors. In addition, the image is 
data of a matrix of dots arranged to form a lattice shape in the vertical (height) and horizontal (width) directions. 
55 In the present embodiment, a computer system is incorporated between the image inputting and outputting appa- 

ratuses as described above. It should be noted, however, that a computer system is not necessarily required. For 
example, Fig. 3 shows an image processing system wherein an image processing apparatus playing a role of correcting 
color reproducibility or the like is embedded in a digital camera 12a and an image based on transformed image data 
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is displayed on a display unit 32a or printed on a printer 31a. In addition, Fig. 4 shows an image processing system 
wherein a printer 31b for printing image data supplied thereto directly without passing through a computer system 
automatically corrects color reproducibility of image data coming from a scanner 11b, a digital camera 12b or a modem 
13b. 

Image processing executed by the computer 21 includes pieces of processing carried out by the picture-element 
count-distribution detecting means and the analogy -degree judging means shown in Fig. 5. Fig. 6 is a flowchart showing 
pieces of processing which are carried out by the offset correcting means, the contrast correcting means and the 
brightness correcting means if the degree of analogy among color components is not small. It should be noted that, In 
a broad sense, the analogy-degree judging means can be said to include a control means for controlling the effective- 
ness of processing carried out at a later stage in accordance with the degree of analogy 

Fig. 5 is a diagrammainly showing processing to recognize a picture-element-count distribution for each color 
component. First of all, picture elements, among which gradations are distributed, are explained. 

Even though a distribution among all picture elements can be found, it is not always necessary to find a distribution 
among all the picture elements since the purpose of finding distribution is to identify a characteristic trend. Thus, it is 
possible to adopt a thinning technique that may result in an error to a certain degree within an allowable range. As 
shown in Fig. 5, the flowchart ot the present embodiment begins with a step S102at which a thinning process is carried 
out to select picture elements, among which distribution of gradations needs to be taken into account. In the case of 
N samples, a statistical error is about l/(N**(1/2)) where notation means involution, that is, an operation to raise N 
to (1/2)th power of N. Thus, in order to make the error smaller than 1%. it is necessary to take at least 10,000 samples 
20 (N - 10,000) or 10,000 picture elements in this case. 

In the case of a bit-map image like one shown in Fig. 7, the image is a two-dimensional dot matrix comprising a 
predetermined number of dots arranged in the vertical direction and a predetermined number of dots arranged in the 
horizontal direction. This bit-map image thus comprises (Width X Height) picture elements where notation Width is the 
number of picture elements arranged in the horizontal direction whereas notation Height is the number of picture ele- 
ments arranged in the vertical direction. A sampling-period ratio is defined by Eq. (1) as follows: 

Ratio = min (Width, Height) / A + 1 (1) 

30 where min (Width. Height) is the smaller one of Width and Height and notation A is a constant. The sampling-period 
ratio is a ratio of the total number of picture elements to the number of picture elements to be sampled, that is, the 
number of picture elements, only one of which is taken as a sample. Let an intersection shown in Fig. 8 indicate a 
picture element and a circle on an intersection shown in the figure denote a sampled picture element. In this case, 
since sampling Is carried out for each two picture elements, the sampling period ratio is 2. That is, one sampling 
35 operation is carried out every other picture element arranged in both the vertical and horizontal directions. For A = 200, 
the number of sampled picture elements on a line is shown in Fig. 9. 

As is obvious from the figure, except for a sampling-period ratio of 1 for which no sampling (no thinning) is carried 
out, that is, each picture element is taken into account, in the case of a bit-map image with a width of at least 200 
picture elements, the number of picture elements to be sampled is seen to be greater than 100. Thus, in the case of 
a bit-map image with a width and height each equal to or greater than 200 picture elements, it is necessary to assure 
that the number of picture elements to be sampled is at least 100 X 100 = 10,000 in order to make the error equal to 
or smaller than 1%. 

The reason why min (width, height) is taken as a reference is explained as follows. Consider a bit-map image like 
one shown in Fig lOA with width » height. In this case, it the sampling-period ratio is determined by using the width 
which is much greater than the height, a large sampling-period ratio or a small number ot picture elements to be sampled 
is obtained. In this case, only picture elements on the two top and bottom lines is most likely extracted in the vertical 
direction as shown in Fig. 10B. If min (width, height) is taken as a reference, on the other hand, the sampling-period 
ratio is calculated from the smaller quantity to result in a smaller sampling-period ratio or a larger number ot picture 
elements to be sampled. In this case, picture elements shown in Fig. IOC are to be sampled. As shown in Fig. IOC, 
50 even in the vertical direction with fewer picture elements, the thinning technique can be applied to include lines between 
the top and bottom lines. 

It is needless to say that, with respect to picture elements sampled by adopting the thinning technique described 
above, picture-element counts are found for the 0th to 255th gradations for the R (red) color and stored in an array of 
variables CNT_R (0) to CNT_R (255) respectively shown in Fig. 11 in order to recognize the picture-element-count 
55 distribution for this red-color component. By the same token, picture-element counts are found for the 0th to 255th 
gradations for the G (green) color and stored in an array of variables CNT G (0) to CNT_G (255) respectively in order 
to recognize the piclure-element-count distribution for this green-color component. Likewise, picture-element counts 
are found for the 0th to 255th gradations for the B (blue) color and stored in an array of variables CNT_B (0) to CNT_B 
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(255) respectively in order to recognize the picture-element-count distribution for this blue-color component. 

In the example described above, picture-element-count distributions are found by adopting the thinning technique 
based on an accurate sampling-period ratio for picture elements arranged in the vertical and horizontal directions. It 
should be noted that this method is also suitable for processing wherein the thinning technique is applied to picture 

s elements which are input sequentially one after another. When applying the thinning technique to a case in which all 
picture elements have been input, however, picture elements can be selected by specifying their coordinates at random 
in the vertical and horizontal directions. In this way, for a predetermined minimum required-picture-element count of 
1 0,000, for example, an operation to extract a picture element at random is carried out repeatedly till the 1 0,000 required 
picture elements are reached. As the 10,000 picture elements are reached, the operation to extract a picture element 

10 is discontinued. 

In addition to a simple thinning process described above in which the thinning technique is adopted by specifying 
only the number of picture elements to be sampled without specifying which picture elements are to be taken as sam- 
pling objects, the thinning technique can be applied by specifying which picture elements are to be sampled. For 
example, small differences in picture-element count among the RGB color components indicate a color close to the 

^5 gray. In this case, only gray picture elements can be extracted for finding a picture-element-count distribution. This is 
because, if only gray picture elements are extracted for comparison of picture-element-count distributions, the color 
characteristic of an input apparatus can be said to be easily judgeable. Fig. 12 is a flowchart representing a thinning 
process in which only such gray picture elements are extracted. As shown in the figure, the flowchart begins with a 
step S302 at which a greatest gradation number of a picture element being processed among color components is 

20 identified. The flow of processing then goes on to a step S304 at which a smallest gradation number of the picture 
element being processed among the color components is identified. Then, the flow of processing proceeds to a step 
S306 at which a maximum gradation difference, that is, the difference between the greatest gradation number identified 
at the step S304 and the smallest gradation number identified at the step S302, is found. Subsequently, the flow of 
processing continues to a step S308 to form a judgment as to whether or not the maximum gradation difference is 

25 within a range between predetermined threshold values. Typically, in the case of a picture element close to the gray 
color the maximum gradation difference is within a range of 52 contiguous gradations. For a maximum gradation 
difference within such a range of gradations, the flow of processing goes on to a step S310 to include the picture 
element being processed in a process to find a picture-element-count distribution among gradations for picture ele- 
ments in the range of gradations. In the case of a maximum gradation difference exceeding such a range of gradations, 

30 on the other hand, the color is determined to be a color other than the gray and the picture element being processed 
is not used in the calculation of a picture-element-count distribution as a gray color. The flow of processing then pro- 
ceeds to a step S312 to shift the processing to a picture element to be processed next. Then, the flow of processing 
continues to a step S314 to find out if all object picture elements have been processed. If all object picture elements 
have been processed, the processing is ended. If not all object picture elements have been processed, on the other 

35 hand, the flow of processing returns to the step S302 to repeat the pieces of processing described so far 

As described above, a picture-element-count distribution among gradations of an image selected by adopting the 
thinning technique is not necessarily appropriate for correcting the image. It is thus necessary to check the following 
three cases. 

The first case is a case of a binary-data image such as a black-and-white image. That is, it is necessary to determine 

"fo whether or not the image is a black-and-white image. In the case of a binary-data image including a black-and-white 
image, the concept of color-reproducibility correction is not appropriate. For a black-and-white image like one shown 
in Fig. 1 3, the picture-element-count distribution of each color component is shown in Fig. 1 4. As shown in Fig. 1 4, the 
picture-element-count distribution is polarized at the two ends of a distribution range of gradations. To be more specific, 
the picture-element-count distribution is polarized at the 0th and 255th gradations. 

45 Thus, a black-and-white image can be checked at a step SI 04 of the flowchart shown in Fig. 5 by forming a 

judgment as to whether or not the sum of the picture-element counts for the 0th and 255th gradations is equal to the 
total number of picture elements selected by adopting the thinning technique and by forming such a judgment for each 
color component. If the sum of the picture-element counts for the Olh and 255th gradations is equal to the total number 
of picture elements selected by adopting the thinning technique for each color component, that is, if the image is found 

50 to be a black-and-white image, the flow of processing goes on to a step S106 to carry out other processing, that is, 
processing other than correction of color reproducibility of an image, canceling the processing to recognize a picture- 
element-count distribution for each color component. In the present embodiment, the processing to correct color re- 
producibility of an image is divided into two major pieces of processing: front-stage processing to recognize a picture- 
element-count distribution for each color component and a back-stage processing to actually correct image data. In 

55 the other processing carried out at the step 8106, a flag is set to indicate that luminance changing processing is not 
to be performed at the back stage, terminating the processing to recognize a picture-element-count distribution for 
each color component. 

Binary data is not limited to black-and-white data. That is, binary data may also be color data. Also in the case of 
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such color binary data, processing to correct the color reproducibility is unnecessary as well. Thus, the state of distri- 
bution is examined and, if the state of distribution indicates color binary data, the processing to correct color reproduc- 
ibility of an innage is canceled due to the fact that the data is color binary data as is the case with blacknand-white data. 
If data is connposed of two colors, the black and an intermediate color, for example, the picture-element-count distri- 
bution for each of the color components is also polarized at two gradations as well. If the two colors are the blue and 
the green, on the other hand, the picture-element-count distribution for the blue-color component is polarized at two 
gradations but the picture-element-count distributions for the red and green colors are each concentrated at the 0th 
gradation. In a word, in the case of binary data, the picture-element-count distribution for a color component is either 
polarized at two gradations or concentrated at a gradation. Thus, by scanning the variable arrays shown in Fig. 11 to 
count the number of gradations with a non-zero picture-element count, it possible to form a judgment as to whether or 
not the image is a binary-data image. 

The second case is a case of a business graph or a natural picture such as a photograph. That is. it is necessary 
to determine whether or not the image is a business graph or a natural picture such as a photograph. It is of course 
necessary to correct the color reproducibility of a natural picture. In the case of a business graph or a painting, however, 
it is only natural that there is polarization in colors used therein from the beginning. It is thus impossible to carry out 
processing to make the characteristics of the color components uniform from sample-count distributions for such an 
image. For this reason, at a step SI 08 of the flowchart shown in Fig. 5, a judgment as to whether or not the image is 
a natural picture is formed. 

In the case of a natural picture including shadows, there is a large number of colors. In the case of a business 
20 graph or a certain painting such as a drawing, however, there is only a limited number of colors used therein. As a 
result, an image can be judged to be not a natural picture if only few colors are used in the image. With each of the 
RGB color components including 256 gradations, 16.700,000 different colors can be expressed. An attempt to accu- 
rately determine the number of used colors among the 1 6,700,000 different colors accurately will require as many array 
variables as the colors. Such a large number of array variables can not practically be implemented. Since picture- 
clcmont-count distributions have already been found, however, it is possible to determine which gradations are used 
effectively in each color component. Thus, the number of colors actually used in a natural picture can be determined. 

Figs. 15A to 15C are each a diagram showing an example of a picture-element-count distribution of a business 
graph. Likewise, Figs. 15D to 15F are each a diagram showing an example of a picture-element-count distribution of 
a natural picture. As is obvious from these examples, the picture-element-count distribution of a non-natural picture is 
30 a line spectrum. In processing carried out by the computer 21 , all the gradations are searched for ones with a non- 
zero picture-element count and the number of gradations with a non-zero picture-element count is counted and added 
up for each color component. In the case of a natural picture, the picture-element-count distribution can be considered 
to be all but uniform over all the gradations for all color components. Thus, the number of gradations with a non-zero 
picture-element count for the three color components is 763 (= 256 per color component X 3 color components) in 
most cases. In the case of a business graph, on the other hand, the number of gradations with a non-zero picture- 
element count for the three color components is only a number of the order of 60 (= 20 per color component X 3 color 
components) even if the number of colors used in each color component is assumed to be as many as 20. Thus, a 
threshold value of 200 can be used as an appropriate criterion as to whether an image is a natural or a non-natural 
picture. That is, if the number of gradations with a non-zero picture-element count for the three color components of 
an image is equal to or smaller than 200, the image can be judged to be a non-natural picture. If the number of gradations 
with a non-zero picture-element count for the three color components of an image is greater than 200, on the other 
hand, the image can be judged to be a natural picture. In the case of a non-natural picture, the flow of processing goes 
on from the step SI 08 to the step S106 to carry out the other processing as is the case with a binary data image. It is 
needless to say that the threshold value can be set at a number other than 200. 
45 In addition, it is also possible to form a judgment as to whether or not the picture-element-count disthbution is a 

line spectrum by finding out whether or not gradations each with a non-zero picture-element count contiguous. That 
is, non-contiguous gradations each with a non-zero picture-element count indicate that the picture-element-count dis- 
tribution is a line spectrum. To put it in detail, it is also possible to form a judgment as to whether or not the picture- 
element-count distribution is a line spectrum by examining a ratio of the number of stand-alone gradations each with 
50 a non-zero picture-element count to the total number of gradations each with a non-zero picture-element count. The 
higher the ratio, that is, the higher the number of stand-alone gradations each with a non-zero picture-element count, 
the more likely the picture-element-count distribution is a line spectrum. Two adjacent gradations each with a non-zero 
picture-element count are not counted as stand-alone gradations each with a non-zero picture-element count. On the 
other hand, a gradation with a non-zero picture-element count which is sandwiched by two gradations each with a zero 
picture-element count adjacent thereto is counted as a stand-alone gradation with a non-zero picture-element count. 
In this way, the ratio of the number of stand-alone gradations each with a non-zero picture-element count to a total 
number of gradations each with a non-zero picture-element count can be found. For example, let both the total number 
of gradations each with a non-zero picture-element count and the number of stand-alone gradations each with a non- 
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zero picture-element count be 64. In this case, the ratio is equal to unity, indicating that the picture-element-count 
distribution is obviously a line spectrum. 

Furthermore, in a case where an image processing program is executed through an operating system, an image 
file can be recognized by examining an extension appended to the name of the file. The contents of a bit-map file used 

5 in particular for storing a photographic image are compressed. In this case, an extension is often appended to the 
name of a file to indicate a hint as to what technique of compression was adopted for compression of the contents of 
the file. For example, an extension 'JPG' indicates that a JPEG format has been adopted for compression of the contents 
of the file. Since the operating system controls the names of files, if a device driver such as a printer makes an inquiry 
about the name of a file to the operating system, the operating system will return the name of the file including an 

10 extension in response to the inquiry. If the extension indicates that the file contains an image of a natural picture, the 
ordinary processing to correct the color reproducibility of the image is carried out. An extension 'XLS'^ an extension 
inherent to a file for storing a business graph, indicates a non-natural picture. In this case, the other processing de- 
scribed above is performed. 

The third case to be taken into consideration is a case of an image with a frame on the circumference thereof. 
15 That Is, it Is necessary to form a judgment as to whether or not a frame exists on the circumference of an image such 
as one shown in Fig. 16. If the frame is white or black, the picture-element-count distribution of each color component 
forms a line spectrum at the two ends of a distribution range of gradations representing the frame and a smooth spec- 
trum for gradations between the two ends corresponding to an internal natural picture enclosed by the frame as shown 
in Fig. 17. 

20 It is needless to say that, since it is proper lo exclude a frame from picture-element-count distribution, the existence 

of a frame can be checked at the step S 108 of the flowchart shown in Fig. 5 by forming a judgment as to whether or 
not the sum of the picture-element counts at the 0th and 255th gradations is sufficiently large and does not match to 
the total number of picture elements selected by adopting the thinning technique. That is, if the outcome of the judgment 
formed at the step SI 08 is YES, the existence of a frame is confirmed in which case the flow of processing goes on 

25 to a step S1 1 2 to carry out frame processing. If it is desired not to carry out the frame processing, the picture-element 
counts at the 0th and 255th gradations of the picture-element-count distribution are reset to zero. In this way, the 
subsequent processing can be carried out in the same way as a case with no frame. 

So far, a black or white frame has been described but a frame may be of another specific color In the case of a 
frame of a specific color other than black and white, the picture-element-count distribution of each color component 

30 forms a protruding line spectrum at a specific gradation representing the frame and a traditional smooth spectrum for 
the remaining gradations corresponding to an internal natural picture enclosed by the frame. Thus, a line spectrum 
having a picture-element count with a big difference from the picture-element counts of the adjacent gradations sand- 
wiching the line spectrum can be interpreted as a frame which can be excluded from the picture-element-count distri- 
bution. However, the color of the frame may be used also in an area outside the frame. In this case, the same color 

3S as the frame used in an area outside the frame is taken Into account by taking an average of the picture-element counts 
of the adjacent gradations sandwiching the line spectrum representing the frame. 

After the first and second cases described above have been taken into consideration at the steps SI 04 and SI 08 
of the flowchart shown in Fig. 5, the flow of processing may eventually go on to a step S114 Instead of proceeding to 
the step SI 06 for carrying out the other processing be the picture an image of the third case with a frame or an image 

40 with no frame. At the step S1 14, the picture-element counts at both the ends of the gradation range are found. In many 
cases, the picture-element-count distribution of a natural picture resembles at! but a mountain as shown in Fig. 18. It 
is needless to say, however, that the position and the shape of the picture-element-count distribution varies from image 
to Image. Statistical observation Indicates that, at the bottom of the picture-element-count distribution, the picture- 
element counts approach a zero unlimitedly as the gradation is shifted toward the ends of the gradation range. Thus, 

45 in spite of the fact that it becomes important to identify the two ends of the mountain-like shape of a picture-element- 
count distribution in an attempt to identify the picture-element-count distribution, in actuality, It is most likely impossible 
to deny the fact that any picture-element-count distribution having a shape resembling a mountain satisfies the condition 
that the picture-element counts approach a zero as the gradation is shifted toward the ends of the gradation range. 
Thus, the ends of the gradation range should be excluded from data for comparing picture-element counts with each 

50 other since every picture-element-count distribution has a zero picture-element count at the ends of the gradation 
range anyway. 

For this reason, a gradation with a certain picture-element count close the lower true end of the gradation range 
(that is, the 0th gradation) and a gradation with a certain picture-element count close the upper true end of the gradation 
range (that is, the 2S5th gradation) are taken as lower and upper pseudo-end gradations to replace the gradations 
55 with a zero picture-element count at the lower and upper true ends of the gradation range respectively. Only a narrower 
gradation range sandwiched by the lower and upper pseudo-end gradations Is taken into account. That is, gradations 
between the lower true-end gradation and a lower pseudo-end gradation on the left-hand side of the gradation range 
and gradations between the upper true-end gradation and the upper pseudo-end gradation on the right-hand side of 
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the gradation range are cut off from a picture-element-count distribution under consideration. In the present embodi- 
ment, a pseudo-end gradation is determined to result in a predetermined distribution ratio, a ratio of the sum of picture- 
element counts for all the cut-off gradations to the total number of picture elements. In the case of the picture-element- 
count distribution ratio shown in Fig. 1 8, the lower and upper pseudo-end gradations for the red color are set at Rmin 

s and Rmax respectively, each giving a distribution ratio of 0.5%. It is needless to say that the value of the distribution 
ratio can be changed properly. By cutting off gradations under and above the lower and upper pseudo-end gradations, 
which are each set at a predetermined distribution ratio in this way, from a picture-element-count distribution under 
consideration, it is possible to ignore black and white points generated due to causes such as noise. Conversely, if 
such processing to exclude gradations under and above the lower and upper pseudo-end gradations from a picture- 

10 element-count distribution under consideration is not carried out, that is, if the 0th and 255th gradations are taken as 
upper and tower end gradations respectively as is the case with most picture-element-count distributions, even one 
existing black or white point may appear as a picture-element count at an end gradation of the picture-element-count 
distribution. By cutting off gradations under the lower pseudo-end gradation to take out a sum of picture-element counts 
equal to 0.5% of the total number of picture elements and gradations above the upper pseudo-end gradation to take 

15 out a sum of picture-element counts equal to 0.5% of the total number of picture elements as described above, however, 
this problem can be solved. 

A sum of picture-element counts equal to 0.5% o1 the total number ot picture elements selected by adopting the 
thinning technique or the total number ot picture elements excluding the frame is computed in the actual processing. 
To put it in detail, a sum of picture-element counts at the upper end of the gradation range is found by sequential 

20 cumulation starting with the upper true-end gradation having a minimum picture element count in the picture-elemenl- 
count distribution, that is, the 255th gradation, toward a gradation having a maximum picture element count. The cu- 
mulation is ended at an upper pseudo-end gradation as the sum of picture-element counts reaches 0.5% of the total 
number of picture elements. By the same token, a sum of picture-element counts at the lower end of the gradation 
range is found by sequential cumulation starting with the lower true-end gradation having a minimum picture element 

2S count in the picture-element-count distribution, that is, the 0th gradation, toward a gradation having a maximum picture 
element count. The cumulation is ended at a lower pseudo-end gradation as the sum of picture-element counts reaches 
0.5% of the total number of picture elements. The upper pseudo-end gradations for the RGB color components are 
referred to as Rmax, Gmax and Bmax respectively. By the same token, the lower pseudo-end gradations for the RGB 
color components are referred to as Rmin, Gmin and Bmin respectively 

30 As described above, it may be rather non-uniform picture-element-count distributions of the RGB color components 

that represent a natural state. In such a case, the color reproducibility should not be corrected. Tracing back from the 
results of the observation, it is possible to make a decision that picture-element-count distributions of color components 
which are similar to each other to a certain degree may conversely need to be made uniform while dissimilar picture- 
element-count distributions should be kept as they are. 

35 For the reason described above, in the present embodiment, the degree of analogy among the picture-element- 

count distributions of the color components is checked at a step S116 of the flowchart shown in Fig. 5. Let the picture- 
element-count distributions of the color components be like ones shown in Fig. 19 and the entire gradation range be 
divided into four zones: 0th to 63rd gradations, 64th to 127th gradations. 128th to 191st gradations and the 192nd to 
255th gradations. Consider a characteristic vector having the picture-element counts in the zones as elements thereof 

40 for each color components. Let R be the characteristic vector for the red-color component, r63, r127, r1 91 and r255 
be the elements of the charactenstic vector R in the four zones and r_pixel is the total number of all picture elements. 
In this case, the characteristic vector R for the red-color component is expressed by Eq. (1) as follows: 

45 ^= [r63X100/r_pixel, r127X100/r_pixel, r1 91 X100/r_pixel, r255X1 00/r pixel] (1) 

By the same token, the characteristic vectors for the green-color and blue-color components can be found. Then, 
inner products of the characteristic vectors for each two color components are found. To be more specific, an inner 
product corr_rg of the characteristic vectors for the red-color and green-color components, an inner product corr_gb 
50 of the characteristic vectors for the green-color and blue-color components and an inner product corr_br of the char- 
acteristic vectors for the blue-color and red-color components are expressed by Eqs. (2), (3) and (4) respectively as 
follows: 



55 corr_rg = ^ * 3" / (IRI * IGI) 
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corr_gb - 5 * 5 / IGI* IBI) (3) 

corr_br=B*R/(IBr IRI) (4) 

An inner product of two characteristic vectors which is also referred to hereafter as a correfation coefficient can 
be said to represent the degree of analogy of the two characteristic vectors. The greater the value of an inner product, 
the higher the degree of analogy between two color components represented by two characteristic vectors represented 
by the inner product. To put it in detail, an inner product has a value in the range 0 to 1 . If even one of the inner products 
corr_rg, corr_gb and corr_br is equal to or smaller than a threshold value CORR which is typically set at 0.7, the degree 
of analogy is judged to be low. In this case, the other processing is carried out at the step S1 06 of the flowchart shown 
in Fig. 5. 

In the present embodiment, the processing based on the inner products of the characteristic vectors constitutes 
the analogy-degree judging means. A method including processing of inner products of characteristic vectors has been 
established and a judgment can thus be formed with ease. It is needless to say, however, that the method is not limited 
to the example explained above. For example, while the entire gradation range is divided into four zones in the case 
of the example, the number of zones into which the entire gradation range is divided can be set at any arbitrary value 
greater than four In addition, the degree of analogy can be found by using a statistical technique based on the end 
positions, the standard deviation and the sharpness of the picture-element-count distribution. 

The following is description of a concrete method for finding the degree of similarity by using such a statistical 
technique. In a typical statistical technique, representative values or variables of a distribution are used. Differences 
in average value, the absolute values of differences in center value and differences in standard deviation (variance) 
between the red-color and green-color components, between the green-color and blue-color components and between 
the blue-color and red-color components are found. Let Ave_rg and Std_rg be the absolute values of the difference in 
average value and the difference in standard deviation between the red-color and green-color components respectively. 
In this case, let a performance function between the red-color and green-color components be set as follows: 



h(rg) = (1 - Ave_rg/255) X (1 - Std_rg/255) 

Likewise, let Ave_gband Std_gb betheabsolute values of the difference in average value and the difference in standard 
deviation between the green-color and blue-color components respectively. In this case, let a performance function 
between the green-color and blue-color components be set as follows: 

h(gb) = (1 - Ave_gb/255) X (1 - Std_gb/255) 



Similarly, let Ave_br and Std br be the absolute values of the difference in average value and the difference in standard 
deviation between the blue-color and red-color components respectively. In this case, let a performance function be- 
tween the blue-color and red-color components be set as follows: 



h(br) = (1 - Ave_br/255) X (1 - Std_br/255) 

Distributions similar to each other have ail but equal average values, all but equal center values and all but equal 
standard deviations. Therefore, the differences in variable are each all but a zero, resulting in performance functions 
h each having a value close to unity. On the other hand, dissimilar distributions exhibit large differences which result 
in performance functions each having a small value. Thus, by comparing the performance functions with a threshold 
value found from experiments, it is possible to make a decision as to whether or not correction of color reproducibility 
is to be carried out. It is needless to say that a center value can be used in the expression of a performance function 
in place of an average value. At any rale, the performance function is not limited lo the expression given above. 

When the degree of analogy to a certain extent among the picture-element-count distributions found for the color 
components from the processing described above has been identified, characteristics of the color components can be 
judged to be identifiable from the picture-element-count distributions. Then, an attempt is nnade to establish uniformity 
among the color components by using the identified characteristics as a basis. It should be noted that, as a result of 
various judgments described above, in some cases, the other processing is carried out and a flag is set at the step 
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S106 of the flowchart shown in Fig. 5. At a step S202 of the flowchart shown in Fig. 6, the flag is examined. In the case 
of a flow coming from the step SI 06 at which the other processing was carried out as evidenced by the set flag, the 
processing is ended without performing processing to establish uniformity among the color components at steps fol- 
lowing S202. 

5 As shown in the flowchart of Fig. 6, the processing to establish uniformity begins with a step S204 at which an 

offset is computed and then corrected initially. In a narrow sense, the correction corresponds to correction of a color 
slippage. An offset for uniforming characteristics is an effective value in the present embodiment. Naturally, there must 
be a relation of direct proportion between RGB color components of a photographic object and the RGB components 
of image data representing the photographic object like one shown in Fig. 20. However, a transformation characteristic 
to for each component may be shifted due to properties of an image pickup device. With the conventional image process- 
ing technology, such a slippage can not be recognized from an ordinary image. If the picture-element-count distributions 
taken for the color components are found all but similar to each other, it is on the contrary possible to form a judgment 
that these picture-element-count distributions should originally match each other In this case, an offset of a slippage 
for each color component can be detected. 

In the case of the present embodiment, the magnitude of an offset of each color component is found at the step 
S204. The flow of processing then goes on to a step S206 to create a table for use in correction of a color slippage by 
taking such offset magnitudes into consideration. 

When pieces of RGB gradation data (Rp, Gp, Bp) are used, the overall luminance yp in equipment such as a 
television receiver is found by using the following equation: 

20 

yp - 0.30*Rp + 0.59*Gp 0. 1 1 *Bp (2) 

As is obvious from the above equation, the green-color component has a greatest effect on the luminance. In this 

25 sense, correction of slippages of the colors other than the green in relation to the green offers a merit that the image 
of a picture as a whole does not change. 

In order to find slippages in picture-element-count distributions among color components, on the other hand, it is 
desirable to take a characteristic portion of each of the picture-element-count distributions into consideration. For this 
reason, in the present embodiment, the upper pseudo-end gradations Rmax, Gmax and Bmax obtained from the end- 

30 gradation processing of the step S114 of the flowchart shown in Fig. 5 described above for the red, green and blue- 
color components respectively are used in conjunction with median gradations Rmed, Gmed and Bmed of the picture- 
element-count distributions for the red, green and blue-color distributions. The lower and upper pseudo-end gradations 
are effective in forming a judgment on properties of a distribution. With respect to the lower pseudo-end gradations 
Rmin, Gmin and Bmin, however, there is a range for which the effect of a slippage is difficult to understand from the 

35 beginning. Thus, the lower pseudo-end gradations Rmin, Gmin and Bmin are eliminated deliberately from the process 
to find and correct slippages in picture-element-count distributions among color components. It is thus possible to make 
a correction by putting an emphasis only on a slippage which is obtained in a range where the effect of a slippage is 
big. A median gradation at the center of a distribution with a shape resembling a mountain can be used to indicate the 
top of the mountain-like shape even if there is a gradation with an extremely large picture -element count. In this case, 

40 being a portion having a great effect on the image of a picture, the mountain portion is effective for grasping the char- 
acteristic. 

From the upper pseudo-end gradations Rmax, Gmax and Bmax as well as from the median gradations Rmed, 
Gmed and Bmed, slippages dRmax and dRmed between the red and green colors and as well as slippages dBmax 
and dBmed between the blue and green colors can be found by using the following equations: 



45 



55 



dRmax = Gmax - Rmax (3) 

dBmax = Gmax - Bmax (4) 

dRmed = Gmed - Rmed (5) 

dBmed - Gmed - Bmed (6) 
Then, by using the slippages of the red and blue colors relative to the green as references, an offset dR for the red- 
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color component and an offset dB can be found from the following equations: 

dR = (dRmax + dRmed) / 2 (7) 

5 

dB = (dBmax + dBmed) / 4 (8) 

where the following limitation is set: -12 < dR, dB < 12. The limitation is set because, by merely taking picture-element- 
fo count distributions into consideration, there may be a case in which the color reproducibility can by no means be 
corrected completely. The typical limits used in the limitation prevent a picture-element-count distribution from being 
much corrected. It is needles to say that the limits are set at proper values which are determined empirically by exper- 
iments. The difference in denominator between the expressions on the right-hand side of Eq. (7) and that of Eq. (8) 
represents a difference in effect between the two colors. By the same token, the denominators can be modified properly 
75 to values found empirically by experiments. 

Since the quantities dR and dB found above are no more than offset values, as actual statistical values, new upper 
pseudo-end and median gradations Rmax2, Bmax2, Rmed2, Bmed2, Rmin2 and Bmln2 are set as follows: 



20 



25 



30 



Rmax2 = Rmax + dR (9) 

Rmed2 - Rmed -t- dR (10) 

Rmin2 = Rmin -hdR (11) 

Bmax2 = Bmax + dB (12) 

Bmed2 = Bmed + dB (13) 



2^ Bmin2 = Bmin -h dB (14) 

It should be noted that the above equations obviously include offset quantities dR and dB of the red and blue colors 
respectively relative to the green and do not change according to the gradation value Thus, in the case of image data 
on actual picture elements, it is sufficient to just add the offset quantities in a uniform manner. 

40 It is worth noting, however, that correction of image data based on other factors is also carried out in the present 

embodiment. If pieces of correction are all done individually, however, the processing time becomes long, causing 
inconvenience. In order to carry out the processing with a high degree of efficiency, at the step S206 of the flowchart 
the processing shown in Fig. 6 in the present embodiment, a table is created for representing a relation associating 
gradation data (R1, G1, B1) of the RGB colors prior to transformation with gradation data (R2, G2, B2) of the RGB 

45 colors after the transformation. In this way, image data is actually corrected only once In the end. 

In the embodiment described above, on the other hand, a degree of analogy is found from inner products of char- 
acteristic vectors and the degree of analogy is then compared with a threshold value CORR of 0.7 in order to make a 
decision as to whether the characteristics are to be uniformed or not. Thus, in a case where the inner products are all 
but equal to the threshold value, a different outcome of the judgment can most likely be resulted in even for the same 

so image due to an effect of bits added to the circumference thereof. 

It is needless to say that, when a decision to uniform characteristics is made, the offset quantities like ones de- 
scribed above are added. When a decision not to uniform characteristics is made, on the other hand, the offset quantities 
like ones described above are not added. Therefore, there are big differences between quantities sandwiching a thresh- 
old value as a result of adding or not adding offsets thereto. 

55 As a method for preventing a result from changing much as described above, the use of a continuously varying 

window function is effective. Let a variable x defined as follows: 
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X = min (corr_rg, corr^gb. corr_br) (141) 
In this case, a window function f(x) is defined below: 

for x< 0.5, f(x) = 0. 
for 0.5 X <= 0.7, f(x) = 5*x - 2.5 and 



for 0.7 < X, f(x) = 1 

^5 The threshold value CORR is set at 0.5. Changes in value of the window function f(x) are shown in Fig. 30. As shown 
in the figure, for x < 0.5, f(x) has a fixed value of 0. For 0.5 x <= 0.7, f(x) increases linearly from 0 to 1.0 and, for 
0.7 < X, f (X) again has a fixed value of 1 .0. When finding the offset dR for the red-color component and the offset dB 
for the blue-color component by using Eqs. (7) and (8) as described above, the right-hand expressions are multiplied 
by f(x) to give Eqs. (7') and (8') as follows: 



dR = f (X) * (dRmax + dRmed) / 2 (7') 



dB = f(x) * (dBmax + dBmed) / 4 (8') 



In the flowcharts shown in Figs. 5 and 6, if the degree of analogy does not exceed the threshold value, the other 
processing is carried out. With the offsets multiplied by a window function as indicated by Eqs. (7') and (8') described 
above, processing represented by a flowchart shown in Fig. 31 is carried out. As shown in the flowchart of Fig. 31, if 

30 the degree of analogy suggests that the other processing is not to be carried out, the flow of processing goes on to a 
step S205 at which the offset quantities are computed by using the window function The offset quantities computed 
in this way are then used. It is needless to say that, since the value of f(x) abruptly approaches a zero for x < 0.7 as 
described above, an image in close proximity to the threshold value does not change much any more. In addition^ with 
regard to an image with a low degree of analogy, the offsets are each all but a zero, having no bad effects. Furthermore, 

35 the new upper pseudo-end and median gradations Rmax2, Bmax2, Rmed2, Bmed2, Rmin2 and Bmin2 can also be 
found from Eqs. (9) to (14) by using the offset quantities dR and dB calculated in this way. 

It is obvious that the window function f(x) is not limited to the one described above. In the example described 
above, the value of the window function is made variable with the minimum value of the correlation coefficients corr_rg, 
corr_gb and corr_br used as a base. It should be noted, however, that the change in value of the window function does 

40 not have to be based on the minimum value of the correlation coefficients corr_rg, corr_gb and corr_br. For example, 
the window function can be defined as a function of correlation coefficients corr_rg, corr_gb and corr_br as follows. 



f(corr_rg, corr_gb, corr_br) (142) 



As an alternative, the window function can also be a general function of statistical quantity as follows. 
f(statistical quantity) 

where the statistical quantity can be any statistical value such as a minimum value, a maximum value, a median value 
or a standard deviation. 

so On the other hand, a window function functions to validate a processed value in a certain area and invalidates 

another processed value in another area as a window is opened and closed. Now, color fogs can be classified by cause 
into a color fog caused by hardware performance or the like of the image inputting apparatus 10 described earlier, an 
intentional color fog resulting from an evening glow or the like and a color fog resulting from special illumination using 
a light source such as a tungsten lamp. As has been described earlier, it is not necessary to uniform characteristics in 

55 the case of an intentional color fog resulting from an evening glow or the like. However, an effort to uniform character- 
istics in the case of a color fog resulting from special illumination using a light source such as a tungsten lamp is 
meaningful. 

An intentional color fog resulting from an evening glow or the tike and a color fog resulting from special illumination 
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using a light source such as a tungsten lamp can be recognized from the correlation coefficients described above. To 
put it in detail, a photograph with extremely low correlation coefficients can be judged to be caused in many cases by 
special illumination. In this case, the window function thereof varies as shown in Fig. 32. 

A new window function f'(x) has values different from those of the window function f(x) shown in Fig. 30 for x < 
0.3. To numerically describe the changes in value of the window function f'(x), 

for x < 0-1, f'(x) = 1.0, 
for 0.1 <= X <= 0.3, f'(x) = -5*x + 1 .5 and 
for0.3<=x<= 0,5. f'(x) = 0. 



As shown in Fig. 32. as the variable x decreases from 0.3, the window function f'(x) again increases linearly. As the 
variable x reaches 0. 1 , however, the window function f '(x) stays flat at a fixed value of unity. It is needless to say that, 
with the window function having a value of unity, the large offset quantities computed on the basis of states of picture- 
element-count distribution for the color components can be used as they are to make the characteristics uniform by 

20 eliminating effects of the illumination. 

It should be noted that the window function does not have to change linearly in a transition region. That is, in a 
transition region, the window function can be a curve which exhibits a monotonously increasing or decreasing value. 

At the step S1 16 of the flowchart shown in Fig. 5, the degree of analogy is checked. If the degree of analogy is 
found low, the flow of processing goes on to a stop SI 06 at which the other processing is carried out and a flag is set. 

25 As an alternative, the processing of the step S1 1 6 is not carried out in the flowchart shown in Fig. 31 and. by computing 
the offset quantities by using a window function at the step S205, the processing to uniform charactehstics can be in 
essence bypassed in the case of a low degree of analogy. For this reason, the correction control means can be said 
to comprise processing software and hardware on which the software is executed. 

If there are big differences in way of spreading among the picture-element-count distributions, on the other hand, 

30 the processing to uniform the picture-element-count distributions is effective. In the present embodiment, while the 
ways in which the picture-element-count distributions spread are being uniformed, the picture-element-count distribu- 
tions are widened as much as possible in order to put an emphasis on the contrast of each of the color components. 

In the transformation processing to put an emphasis on the contrast of each of the color components in the gradation 
range 0 to 255, color components (R2, G2, B2) of the gradation data after transformation are found from color com- 

35 ponents (R1, G1, B1) of the gradation data prior to transformation, the upper pseudo-end gradations Rmax2, Gmax 
and Bmax2 of the components and the lower pseudo-end gradations Rmin2, Gmin and Bmin2 of the components by 
using the following equations: 



where 



R2 =far X R1 + f br (15) 

G2 = fagX G1 -f-fbg (16) 

B2 = fabX B1 + fbb (17) 

far = 255 / (Rmax2 - Rmin2) (18) 

fag = 255 / (Gmax - Gmin) (1 9) 

fav = 255 / (Bmax2 - Bmin2) (20) 
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fbr = - far X Rmin2 or 255 - far X Rmax2 (21 ) 

5 fbg = -fag X Gmin or 255 - fag X Gmax2 (22) 

fbb = -lab X Bmin2 or 255 - fab X Bmax2 (23) 

10 In the equations described above, for R2, G2 and B2 < 0, R2, G2 and 82 are each set at a zero. For R2, G2 and 

82 > 255, on the other hand, R2, G2 and 82 are each set at 255. Notations far, tag and fab can each be said to be 
represent a gradient whereas notations fbr, fbg and fbb can each be said to represent an offset. By using the transfor- 
mation equations described above, a picture-element-count distribution having a small width can be widened to a 
reproducible range as shown in Fig. 22. It should be noted that, In enlargement of a distribution range of luminance, 

is basically, the total number of picture elements does not change. Therefore, the area of the histogram also remains 
unchanged as well. In an attempt to enlarge a distribution range of luminance by utilizing the reproducible range to its 
maximum, however, a high-light portion turns white to come off while a high-shadow portion becomes a destroyed 
black one. In order to avoid this problem, in the present embodiment, the gradation range to be enlarged is limited. To 
pul it in detail, as a range nol to be enlarged, five gradations are left in each of the upper and lower ends of the whole 

20 gradation range. As a result, the parameters used in the transformation equations are expressed by the following 
equations: 

far = 245 / (Rmax2 - Rmin2) (24) 

25 

fag = 245 / (Gmax - Gmin) (25) 
fav = 245 / (Bmax2 - Bmin2) (26) 
fbr = 5 - far X Rmin2 or 250 - tar X Rmax2 (27) 
fbg - 5 -tag X Gmin or 250 - fag X Gmax2 (28) 



30 



35 



40 



fbb = 5 -fab X Bmin2 or 250 - fab X 8max2 (29) 



By using the above parameters, gradations below the 5th gradation and those above the 250th gradation are not 
subject to transformation. 

As described above, in the present embodiment, in order to sustain the high-light and high-shadow portions, a 
sub-range of five gradations starting from the lower true end of the gradation range and a sub-range ot five gradations 

4S Starting from the upper true end of the gradation range are each set as a non-enlargement area in a uniform manner. 
It should be noted, however, that in the case of an image outputting apparatus whereby the high-light and high-shadow 
portions are relatively easy to reproduce, the sub-ranges can be made narrower. In the case of an image outputting 
apparatus whereby the high-light and high-shadow portions are relatively difficult to reproduce, on the other hand, the 
sub-ranges can be made wider. In addition, instead of treating each of such sub-ranges as a non-enlargement area 

so in a uniform manner, the enlargement factor is gradually limited as transition is made along the gradation range toward 
the upper and/or lower true ends. 

Fig. 23A is a diagram showing a narrow luminance distribution of an image. If the enlargement factors (correspond- 
ing to the parameters far, fag and fab) of the luminance distribution are applied as described so far, extremely large 
enlargement factors adjusted to a reproducible range may result. In this case, in spite of the fact that it is natural to 

55 have a narrow contrast range from the brightest portion to the darkest portion in the state of a dark sunset such as an 
evening, as a result of much enlarging the contrast range of the image, the image is most likely transformed into an 
image of a day time. Since such a transformation is not desired, a limit is imposed on each of the enlargement factors. 
To be more specific, the parameters far. fag and fab are each limited to a value not exceeding the range 1 .5 to 2.0. In 
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this way, a dark sunset will be expressed as a dark sunset in its own right. 

A case in which the enlargement factors are not limited is shown by a single-dotted line in Fig. 23A with no excess 
portions left in the reproducible range after transformation. If the enlarged range is limited, however, freedom to select 
a place to which the distribution after transformation is to be brought is obtained as shown by double-dotted lines in 
5 Fig. 23B. In some cases, the image as a whole most likely becomes too bright or too dark. Thus, in such a case, 
transformation is carried out so that the ratio (m1 : m2) of an excess portion left at the upper end of the gradation range 
to an excess portion left at the lower end of the gradation range prior to transformation is equal to the ratio (n1 : n2) of 
an excess portion left at the upper end of the gradation range to an excess portion left at the lower end of the gradation 
range after transformation. 

to As described above, processing to find the parameters far, fag, fab, fbr, fbg and fbb is carried out at a step S208 

of the flowchart shown in Fig. 6. The flow of processing then goes on to a step S210 at which a transformation table 
is created as is the case with the processing carried out at the step S206. Fig. 21 is a diagram showing a transformation 
table. The component values (R2, G2, B2) of gradation data after transformation in the table created at the step S206 
are now used as component values (R1 , G1 , B1) of the gradation data prior to transformation. To put it in more detail, 

f5 the existing component values (R2, G2, 82) of gradation data after transformation in the table created at the step S206 
are input to find new component values (R2, G2, 82) of gradation data after transformation by using Eqs. (15) to (17). 
The new component values (R2, G2, 82) are then used to replace the existing component values (R2, G2, 82) . In this 
way, by referencing the transformation table updated at the step S210, two pieces of processing, that Is, addition of 
the offset quantities found at the step S204 and the processing to put an emphasis on each of the contrasts found at 

20 the step S208 are implemented at the same time. 

As another slippage in picture-element-count distribution among color components, on the other hand, the overall 
brightness remains to be taken into consideration. For this reason, in order to carry out y correction to make brightness 
slippages uniform at a step S214of the flowchart shown In Fig. 6, the values of yis found at a step S212. For example, 
if the mountain-like shape of the picture-element-count distribution for the red-color component shown by a solid line 

2B in Fig. 24 inclines to the dark side as a whole while the mountain-like shape of the pIcturo-elomGnt-count distribution 
for the blue-color component shown by a single-dotted line in the same figure inclines to the bright side as a whole, 
correction and shifting are done so that the picture-element -count distribution of the green-color component as a whole 
forms a centered mountain-like shape as shown by a dashed line in the same figure. 

As a result of carrying out a variety of experiments, in the present embodiment, a judgment on an image is formed 

30 with a median gradation of the picture-element-count distribution of the image used as a reference is far as y correction 
is concerned. If the median gradation is lower than the 85th gradation, the image is judged as dark. In this case, y 
correction is carried out by using y values found as follows. 



35 



40 



45 



or 



y r = Rmed2 / 85 (30) 
yg = Gmed/85 (31) 
yb=Bmed2/B5 (32) 

y r = (Rmed2 / 85) (1/2) (33) 

y g = (Gmed / 85) ** (1/2) (34) 

so 

y b = (Bmed2 / 85) ** (1/2) (35) 

In this case, if the values of y r, y g and y b are smaller than 0.7, y r, y g and y b are set at a value of 0.7. This is 
55 because, if such a limit is not set, a night image will be transformed into one like a day-time image. It should be noted 
that, if an image becomes too bright, the image as a whole becomes whitish, easily turning into an image with a weak 
contrast. In this case, processing such as putting an emphasis by adjustment of the chroma or processing based on 
saturation is appropriate. 
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If the median gradation is higher than the 1 28th gradation, on the other hand, the innage is judged as bright. In this 
case, Y correction is carried out by using 7 values found as follows. 

yr = Rmed2/ 128 (36) 

Yg = Gnned/128 (37) 

yb^ Bmed2 / 1 28 (38) 

or 



Y r = (Rnned2 / 1 28) ** (1 /2) (39) 
Yg = (Gnned 128)** (1/2) (40) 

Y b = (Bmed2 / 1 28) ** ( 1 /2) (41 ) 

In this case, if the values of y r, y 9 and y b are greater than 1 .3, y r Y 9 Bnd y b are set at a value of 1.3. This is 

2S because, if such a limit is not set, the innage can become too dark. It should be noted that, if the image becomes too 
dark, the amounts of color becomes excessive, causing the image to look deep. In this case, processing such as 
weakening the chroma emphasis through adjustment is proper. It should be noted, however, that for photographic 
objects with a bright background, such processing to darken the image on the contrary has a bad effect in some cases. 
This is because, for scenery pictures with the sky occupying half thereof or commemoration pictures taken on a clear 

30 day, for example, the face of a person therein may in many cases be more or less depressed in darkness due to 
counter-light, that is, light from a source behind the photographic object propagating toward the camera, even if no 
processing to darken the image is carried out at all. For such images, dark and bright portions are mixed so that, when 
the standard deviation for each color component is found, a relatively high value of the standard deviation is obtained 
in many cases. Thus, in the case where such a standard deviation is greater than 70, it is possible to exclude the y 

35 processing to make the image dark. An associative relation for a case in which the y processing is carried out is shown 
in Fig. 25. As shown in the figure, for y ^ Y 9 and y b smaller than unity, an upward-convex curve is obtained but, for y 
r. Y 9 and y b greater than unity, on the other hand, an downward-convex curve is resulted in. It should be noted that 
the correction of brightness does not have to be based on a picture-element-count distribution. That is, brightness can 
also be evaluated from other elements prior to correction. 

40 y correction using y r, Y 9 and y b determined as described earlier is carried out in accordance with the following 

equations. Gradation values R1 , G1 and 81 prior to transformation are transformed into gradation values R2, G2 and 
82 after transformation as follows: 



R2 = 255 * (R1 / 255) ** y r (42) 
G2 = 255 * (G1 / 255) ** y 9 (43) 
82 = 255 * (B1 / 255) ** y b (44) 



It should be noted that this y correction is also executed for the transformation table shown in Fig. 21 much like 
the processing to add offset quantities and the processing to put an emphasis on each of the contrasts described 
55 earlier That is. the component values (R2. G2, 82) of gradation data after transformation in the table created at the 
step S210 are now used as component values (R1, G1, 81) of the gradation data prior to transformation To put it in 
more detail, the existing component values (R2, G2, B2) of gradation data after transformation in the table created at 
the step S210 are input to find new component values (R2, G2, 82) of gradation data after transformation by using 
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Eqs. (42) to (44). The new component values (R2, G2, B2) are then used to replace the existing conrtponent values 
(R2. G2, B2) . In this way, by referencing the updated transformation table, the processing to carry out brightness is 
carried out at the same time as addition of the offset quantities found at the step S204 and the processing to put an 
emphasis on each of the contrasts found at the step S20B. 

5 Finally, at a step S21 6 of the flowchart shown in Fig. 6. transformation is carried out on the image data. Processing 

to obtain image data (Rm, Gm, Bm) after transformation from the image data (rm, gm, bm) prior to the transformation 
by referencing the transformation table shown in Fig. 21 is repeated for all picture elements. 

In the present embodiment, the correction based on the offset quantities, the processing to put an emphasis on 
the contrast and the correction of the brightness are carried out in the order they are enumerated here. It should be 

TO noted, however, that they do not necessarily have to be all performed. In addition, the pieces of processing can be 
modified properly prior to the individual implementation. 

For example, in the processing to put an emphasis on each of the contracts carried out by the embodiment de- 
scribed above, correction is made by using the transformation equations which represent linear relations with compo- 
nent values prior to the transformation. It should be noted, however, that in order to make the transformation smooth, 

15 the so-called S-curve transformation like one shown in Fig. 26 can also be performed. In this case, instead of judging 
the state of spreading of a picture-element-count distribution at the two end positions, it is possible to embrace the 
concept of the standard deviation representing the degree of dispersion of the picture-element-count distribution. The 
following is description of an example to put an emphasis on a contrast in accordance with an associative relation 
utilizing a standard deviation. It should be noted that, since all processing methods are common to the transformation 

^0 based on picture-elemenl-counl dislribulions of color components, the luminance is taken as a representative statistical 
quantity and a procedure for obtaining the luminance Y after transformation from the luminance y prior to the transfor- 
mation is explained. 

While actually there are two concepts with regard to the standard deviation, in the present embodiment, processing 
is based on the following equation: 

25 

n 
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o = {(1/n) X Z (yp - ym) **2} **l/2 (45) 
P=l 



where 



yp: the pre-transformation picture-element luminance and 

ym: the average of values of the pre-transformation picture-element luminance 

The standard deviation represents the amount of spreading of a luminance distribution. In this sense of representing 
40 the amount of spreading of a luminance distribution, the slippage can also actually be used as well. In addition, since 
there are a total of 256 gradations as is the case with the present embodiment, the amount of spreading can also be 
found from the sharpness k of the luminance distribution. 



n 



k - {S (yp - ym) **4}/(nXa**4) (46) 
p=l 



It should be noted that a sharpness k of 3 corresponds to the amount of spreading of a normal distribution. 

Based on the standard deviation c which is found as described above to represent the amount of spreading of a 
luminance distribution, in the processing to put an emphasis on a contrast, many gradations are assigned to a range 
55 with a high distribution density and only few gradations are assigned to a range with a low distribution density With an 
associative relation represented by the so-called S curve as shown in Fig. 26, a gradation range RNGi assigned after 
transformation is wider than a gradation range rngO assigned prior to the transformation, indicating that the number of 
gradations assigned after the transformation increases. As for ranges outside the gradation range rngO on the low- 
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luminance and high-luminance sides of the input, on the other hand, the gradation ranges assigned after the transfor- 
mation becomes narrower 

In the present embodiment, the middle position ymid of the gradation range is the 1 28th gradation, y correction is 
carried out by providing y 1 for the gradation sub-range below the middle position ymid and providing y2 for the gradation 
sub-range above ymid. The values of y 1 and y 2 are determined from the standard deviation a by using the following 
equations: 

For y <= 128. 

y ^ ~ {o stdjimit / a ) ** fc (47) 

For y > 128, 

Y 2 = (a / a std_limit) ** fc (48) 



The above parameters are computed at the step S204 of the flowchart shown in Fig. 6. Notations a stsdjimit and fc 
used in the above equations are parameters found from experiments by taking results of the transformation into con- 

20 sideration. In the present embodiment, the values of a stdjimit and fc are 128 and 0.1 respectively. Since the standard 
deviation a located approximately has a value smaller than 128, for a large value of the standard deviation o in the 
above equations, y 2 and y 1 each approach un ity, making the gradient of the S curve gradual. Such an S curve indicates 
that, in the case of a large amount of spreading, for the pre -transformation gradation range rngO with its center coinciding 
with the middle position ymid, the post-transformation gradation range RNGO is not so much widened. For a small 

25 value of the standard deviation o in the above equations, on the other hand, y 2 and y 1 each depart from unity, making 
the gradient of the S curve steep. Such an S curve indicates that, in the case of a small amount of spreading, for the 
p re-transformation gradation range rngO with its center coinciding with the middle position ymid, the post-transformation 
gradation range RNGO is much widened. To put it in more concrete terms, such an S curve indicates that, in the case 
of image data with the luminance thereof distributed only over a narrow range, transformation to widen the range of 

30 the luminance is carried out. 

In the present embodiment, the associative relation of the S curve is established by y correction. In the case of an 
S curve shown in Fig. 27, five points on the y axis representing the luminance prior to the transformation, that is, the 
0th gradation, the lower-side quarter point yql , the middle point ymid, the upper-side quarter point yq3 and the 255th 
gradation are taken as reference points. At the 0th gradation, the middle point ymid and the 255th gradation, the 

35 luminance Y after transformation is made equal to the luminance y prior to the transformation (Y = y) . Determination 
of transformation points, that is, the values of luminance Y after transformation, at the lower-side quarter point yql and 
the upper-side quarter point yq3 is based on standard deviations. Finally, an associative-relation curve connecting 
these five points is found by spline interpolation or Newton's interpolation. It is needless to say that the spline interpo- 
lation or Newton's interpolation can be applied to a portion of the curve. For example, the interpolation can be applied 

40 to a curve portion connecting the three points at the three reference points on the lower side: the middle point ymid, 
the lower-side quarter point yql and the 0th gradation. By the same token, the interpolation is applied to a curve portion 
connecting the three points at the three reference points on the upper side: the middle point ymid, the upper-side 
quarter point yq3 and the 255th gradation. 

To put it in detaiL as shown in a flowchart of Fig. 28, the standard deviations a r, a g and a b of the color components 

45 are found at a step S230. At the following step 8232, y 1 and y 2 for each of the color components are calculated. 
Finally, at a step 8234, a transformation table based on an associative relation utilizing y 1 and y 2 is created. The 
pieces of processing of the steps S230 to S234 are executed in place of those of the steps 8208 to 8214 of the flowchart 
shown in Fig. 6. 

The following is description of operations of the present embodiment having the configuration described above, 
50 following an order in which the operations are carried out. 

When an image is taken by using an instrument such as the scanner 11 shown in Fig. 2. image data representing 
the image in terms of RGB gradation data is supplied to the computer 21 The CPU employed in the computer 21 
executes an image processing program represented by the flowcharts shown in Figs. 5 and 6, carrying out processing 
to correct the color reproducibility of the image data. 

As shown in Fig. 5, the flowchart begins with the step SI 02 at which a thinning process is carried out on image 
data within a range prescribed by a predetermined allowable error to select picture elements and a picture-element- 
count distribution of the selected picture elements among gradations is found for each of the color components. Since 
the picture-element-count disthbutions can not be used as they are, however, at the following step SI 04. a judgment 
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is formed to determine whether or not the image is a binary-data image such as a black-and-white image. Subsequently, 
at the step SI 08. a judgment is formed to determine whether or not the image is a natural picture. Unless the image 
is a binary-data image or not a natural picture, the flow of processing goes on to the step S110 to form a judgment as 
to whether or not the image includes a frame. If the Image includes a frame, the frame is removed. Then, the flow of 
5 processing proceeds to the step Si 1 4 at which unclear zones at the two ends of the picture-element-count distribution 
are taken out. In this state, a characteristic vector representing the picture-element-count distribution of each of the 
color components is found. Then, the flow of processing proceeds to the step S116 at which inner products of the 
characteristic vectors for each two color components are found to check the degree of analogy among the picture- 
element-count distributions. Picture-element-count distributions of the color components very dissimilar to each other 

10 are an evidence indicating that the balance of color is shifted deliberately in the original image data, making It unnec- 
essary to carry out processing to uniform the characteristics. If comparison with a predetermined threshold value in- 
dicates that analogy Is observed to a certain degree, however, the balance of color Is judged to be shifted inadvertently 
In this case, the following processing shown in Fig. 6 to uniform the characteristics is carried out. 

At the step S204 of the flowchart shown in Fig. 6, offsets dR and dB for the red-color and blue-color components 

75 respectively relative to the green-color component are found by using the upper-end and median gradations of the 
picture-element-count distributions. At the following step S206, an Initial transformation table for use in the final trans- 
formation of the image data is created. Subsequently, at the step 8208, parameters for putting an emphasis on the 
contrast are found and the contrast of each of the color components is made uniform. At the next step 8210, while the 
parameters are being used for putting an emphasis on the contrast, the transformation table Is updated for adjusting 

20 the balance of contrast among the color components. Then, al the step 8212, parameters of the y correction for uni- 
forming the degrees of brightness of the color components are calculated and the transformation table for implementing 
the Y correction is re-updated Into a final transformation table. 

Finally, at the step S216, transformation is carried out on the image data for all picture elements by referring to 
the final transformation table created so far. 

25 At the first step S202 of the flowchart shown in Fig. 6, a judgment Is formed to dGtormine whether or not analogy 

exists and a decision based on the existence of analogy Is made to determine whether or not the pieces of processing 
represented by the flowchart shown in Fig. 6 described so far are to be carried out. When the processing represented 
by the flowchart shown in Fig. 31 Is carried out, effective values, that is, offset quantities, are changed In accordance 
with the degree of analogy causing in essence the processing to uniform characteristics to be performed or not to be 

30 performed. 

It is needless to say that, If the image Is an image such as a binary-data image or an image other than a natural 
picture described above, the processing represented by the flowchart shown in Fig. 31 is not carried out. With the 
image processing provided by the present Invention carried out, however, even in the case of image data with poor 
color reproducibility due to color slippages caused by an image Inputting apparatus used for inputting a photograph, 

35 quantities such as the color slippage, the contrast and the brightness are made uniform for each of the color components 
and, at the same time, an emphasis is put on the contrast, making it very easy to obtain a well pitched and good Image. 

In the embodiment described above, some parameters are set at fixed values. It should be noted that, however, 
that the user can select values of the parameters through a predetermined GUI of the computer 21 . 

As described above, at the step SI 02 of the flowchart shown in Fig. 5, the picture-element-count distribution of 

40 each of the color components is found for image data by adopting a method such as the thinning technique and, at 
the step S1 16, a judgment as to whether analogy exists among the picture-element-count distribution Is formed. If the 
degree of analogy is not low, characteristics identified from the picture-element-count distributions are judged to nat- 
urally match each other from the beginning. In this case, color slippages are corrected in the pieces of processing 
carried out at the steps S204 to 8216 of the flowchart shown in Fig. 6 by correcting offsets, putting an emphasis on 

45 the contrast of each color component and correcting the brightness so that a well pitched and good image can be 
obtained even from image data with poor color reproducibility In addition, since the processing Is automated, even an 
untrained operator can correct the balance of color with ease. At the step 8205 of the flowchart shown in Fig. 31 , offset 
quantities are corrected In accordance with a degree of analogy to be used in correction of color slippages. 

50 Second Embodiment 

Next, a second embodiment provided by the present invention is explained. 
The present embodiment comprises the steps of: 

55 1 . determining proper brightness for forming a judgment on color slippages from actual image data; 

2. obtaining components of the brightness; 

3. computing color slippages; and 

4. carrying out processing to correct the color slippages found at the above step in order to individually correct 
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component values of gradation-color-specification data so as to absorb the color slippages. 

it is needless to say that the above pieces of processing are carried out by the innage processing apparatus 20. 
In this sense, the innage processing apparatus 20 comprises a color-slippage computing means and a color-slippage 
correcting means as shown in Fig. 33. 

In the present embodiment, a computer system for processing an image is incorporated between the image input- 
ting apparatus and the image outputting apparatus. It should be noted, however, that the computer system is not always 
required. For example, in a digital still camera 12a shown in Fig. 34, an image processing apparatus for correcting 
color slippages is incorporated. As shown in the figure, the digital still camera 1 2a has an image pickup unit comprising 
an optical system 12a1 and an electro-optical conversion unit 12a2 implemented typically by a CCD. The digital still 
camera 12a also includes an image memory unit 12a4, a color-slippage correcting unit 12a5 and a control unit 12a3 
for controlling conversion of an optical image into a digital image which can then be stored in the image memory unit 
12a4. The color-slippage correcting unit 12a5 is used for correcting color slippages included in image data. In such a 
case, the color-slippage correcting unit 12a5 is implemented by hardware such as an LSI or software. 

In addition, color slippages can be absorbed on the output side regardless of the input equipment. For example, 
a printer driver shown in Fig. 35 comprises a rasteriser 21 a1 tor cutting out a scanning range of a printing head employed 
in the printer from image data output by a printing application, a color transforming unit 21a2 for transforming RGB 
gradation-color-speciftcation data into GMY gradation-color-speciftcation data by referring to a color transformation 
table for ail picture elements in the scanning range and a gradation transforming unit 21 a3 for transforming gradations 
20 of the CMY gradation-coior-specification data into those of binary data as is the case with an ordinary printer driver. 
However, a color correcting module 21b for correcting color slippages of image data is included at a stage in front of 
the rasteriser 21 al. By having such a configuration, image data can be printed with problems of color slippages solved 
at the printing time without regard to what image data has been supplied to the printer. 

Figs. 36 and 37 are diagrams each showing an order of implementation of a color correcting module employed in 
a configuration wherein the color correcting module is considered as a module separated from other image processing 
modules. In the configuration shown in Fig. 35, the color correcting module 21b precedes the other image processing 
modules 21a, that is, the rasteriser 21 al, the color transforming unit 21 a2 and the gradation transforming units 21 a3, 
as is the case with the configuration shown in Fig. 36. As an alternative embodiment, the color correcting module 21b 
can be placed at a stage following the image processing module 21a as shown in Fig. 37. If the image processing is 
merely color transformation from the RGB into the CMYK, it will be sufficient to find color slippages for the CI^YK 
gradation-color-specification data even though it is not suitable for a printer driver wherein the output is print data of 
two gradations. Since the CMYK gradation-coior-specification data comprises ail but equal color component values, 
the color slippages can be found and corrected by adopting the same methods. 

The following is description of an actual image processing program executed by the computer 21 with reference 
35 to a flowchart shown in Fig. 38. 

As shown in the figure, the flowchart begins with a step S41 0 at which a process to determine processing brightness 
is carried out. The process to determine processing brightness is carried out to identify a range of brightness that is 
proper for forming judgment on color slippages from real image data. The process comprises thinning processing, 
brightness-tabulation processing and brightness-determination processing. 

In detection of a color slippage in a low-brightness or high-brightness area, there is a relation between the bright- 
ness y of a real image which serves a source of image data and the bhghtness Y of the image data shown in Fig. 39. 
As shown in the figure, in the low-brightness or high-brightness area, the brightness Y of the image data gets saturated 
with respect to the brightness y of a real image due to characteristics of the image inputting apparatus. That is. at 
bhghtness values y higher than a certain value, the brightness Y reaches a maximum while, at brightness values y 
lower than another certain value, the brightness Y becomes a minimum. Here, color slippages are generated at equip- 
ment such as the image inputting apparatus 10 due to small slippages among the RGB component values for non- 
chroma blacl< and white colors as shown in Figs. 40 and 41. In the saturated zones, however, slippages among the 
RGB component values disappear. For this reason, it is meaningless to observe component values merely at the 
maximum and minimum brightness values. If a brightness on the inner side at a predetermined uniform difference in 
brightness from the maximum or minimum brightness value is used as a reference, on the other hand, whether the 
image data under observation means a white or btacl^ color is indeterminate. 

In the present embodiment, in this sense, a brightness distribution like one shown in Fig. 42 is found. Noise and 
saturated zones are eliminated. In addition, a brightness having a maximum or minimum value which can be inferred 
to imply a white or black color is found, in the process to determine processing brightness, first of all, a thinning process 
55 to extract sampling-object picture elements is carried out by using the same method as the one described earlier. 

Then, a brightness distribution is tabulated at the same time as the thinning process, it should be noted, however, 
that picture-element data of picture elements selected in this way does not have to include information on brightness 
as a component element. In the low-brightness or high-brightness zone, the RGB component values in a mutually 



25 



30 



40 



50 



30 

BNSDOCID: <EP 0843465A2_L> 




EP 0 843 465 A2 

equal relation for representing the white or black color should approach a maximum or minimum value and the objective 
is to find their slippages. Thus, in this case, accurate brightness is not required. Addressing this condition, a brightness 
yp at a point P is found on the basis of Eq. (2) given earlier It should be noted that, if merely an approximate value of 
the brightness yp needs to be calculated, the following equation which does not take the addition weight of each 
5 component into consideration can be used: 



yp = (Rp + Gp + Bp) / 3 (53) 

TO The expression on the right-hand side of Eq. (53) is simplified in comparison with that of Eq. (2). 

In the tabulation of a brightness distribution, the brightness range is set as a range of integers from 0 to 255. The 
degree of brightness of a sampled picture element is found and expressed in terms of an integer. The number of picture 
elements with an equal degree of brightness is counted and associated with the degree of brightness which is expressed 
by one of the integers in the range 0 to 255. In actuality, an array of variables having subscripts ranging from 0 to 255 

^5 are provided. The variables are each used for storing a picture-element count resulting from the counting of the number 
of picture elements with an equal degree of brightness. To put it in detail, each time a picture element having a certain 
degree of brightness is encountered, the value of the variable with a subscript indicated by the degree of brightness 
is incremented by one. 

After a brightness distribution is tabulated in this way, a degree of brightness Ymax is determined at such a position 

20 on the upper side of the brightness range that the sum of picture-element counts for degrees of brightness higher than 
Ymax is equal to 0.5% of the total number of sampled picture elements. In the present embodiment, color slippages 
are tabulated at the brightness Ymax on the upper side of the brightness range. When color slippages in the low- 
brightness zone are also to be detected, a degree of brightness Ymin is determined at such a position on the lower 
side of the brightness range that the sum of picture-element counts for degrees of brightness lower than Ymin is equal 

25 to 0.5% of the total number of sampled picture elements. Fig. 42 is a diagram showing Ymax and Ymin obtained by 
shifting brightness points toward the mid position from the upper and lower end of the brightness range respectively 
As shown in the figure, Ymax and Ymin serve as limits of hatched zones each having an area equal to 0.5% of the 
total area enclosed by the distribution curve and the Y axis on the upper and lower sides of the brightness range 
respectively. By avoiding saturated zones in this way, it is possible to obtain brightness at which color slippages are 

30 recognized as shown in Figs. 40 and 41 . 

The flow of processing represented by the flowchart shown in Fig. 38 then goes on to a step S420 at which an 
average of component values at the upper-limit brightness Ymax and an average of component values at the tower- 
limit brightness Ymin are computed. To put it in detail, an average of degrees of brightness of a color component for 
picture elements of the image data contributing to the upper-limit brightness Ymax and an average of degrees of 

35 brightness of a color component for picture elements of the image data contributing to the lower-limit brightness Ymin 
are calculated. In the case of the present embodiment, two passes of processing are thus executed. In the first pass, 
the degrees of processing brightness are determined after tabulating a picture-element-count distribution. Then, in the 
second pass, image data is again searched for data providing the degrees of brightness in order to calculate the 
averages described above. 

40 For outstanding luminance observed at the sampling time, on the other hand, the degrees of brightness contributing 

to the outstanding luminance for each color component can be added up in order to compute an average without going 
through the two passes. For example, let us set forth a premise that the upper-limit brightness Ymax seems to settle 
at a value in the range 231 to 255. In this case, when a degree of brightness is found at a sampling time to be in this 
range, a product of the degree of brightness for a color component and the picture-element count at the degree of 

45 brightness is cumulated in an array variable associated with the degree of brightness for the color component. Then, 
when the value of the processing brightness has been finally determined, the cumulated total of such products for each 
color component is divided by a picture-element count at the processing bhghtness in order to find an average degree 
of brightness for each color component. 

In the present embodiment, a general average is used as a representative value. It should be noted, however, that 

50 a representative value is not limited to a general average. For example, a maximum and a minimum of image data for 
each color component at an equal degree of brightness are found in order to determine a middle value which can be 
used as a representative value. In a word, an attempt is made to find a color slippage generated in the image inputting 
apparatus from representative values for the color components at a certain degree of brightness. 

The flow of processing represented by the flowchart shown in Fig. 38 then goes on to a step S430 at which color 

55 slippages A R, A G and A Bare found from average values Rav, Gav and Bav of the RGB color components respectively 
by using the following equations: 
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A R ^ Rav - Ymax (54) 
5 AG = Gav - Ymax (55) 

A B = Bav - Ymax (56) 

10 Thus, color slippages can each be considered as a difference from the processing brightness as shown in the 

formulas for computing the color slippages. As a possible alternative method, for example, a color slippage can be 
considered tor example as a clog raiser of another component value relative to a maximum of component values. 

Then, the flow of processing proceeds to a step S440 at which image data is corrected by using the color slippages 
A R, A G and A B. 

15 By the way, when the color slippages A R, A G and A B are applied to component values of image data in a process 

to correct the Image data to be described later, an excessively corrected result is obtained. Even though it is no more 
than a matter of human sense, in order to obtain a better result, the color slippages A R, AG and A R can be compressed 
by using the following equations: 

20 

5 R = A R / a (57) 
S G = A G / a (58) 

25 

5 B = A B / a (59) 

where notation a is a parameter having a value in the range 3 to 4. The compression of color slippages obtained 
30 arithmetically as described above can be said to be a sort of technique of correction to be applied to image data rather 

than just compensation for errors generated in a process of finding the color slippages. Thus, the compressed color 

slippages are determined at the same time as the correction of the color slippages described as follows. 

When applying the correction quantities 5 R, 6 G and 5 B to image data with an upper-limit brightness Ymax, the 

correction quantities should vary linearly so that, for RGB component values of (0, 0, 0), the correction quantities are 
35 each a zero. Let i (i = 0 to 255) represent a component value. In this case, the correction quantities 6 R(i), 5 G(i) and 

5 B(i) are expressed as follows: 
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6 R(i) - 6 R X t / Rav (60) 

§ G(i)= S G X i/Rav (61) 

5 B(i)= 5 BX i / Rav (62) 
Thus, for a point P with component values (Rp. Gp, Bp), the component values are corrected as follows: 

Rp = Rp + 6 R (Rp) (63) 

Gp = Gp + 6 G (Gp) (64) 

Bp = Bp + 5 B (Bp) (65) 

The above correction will result in a beautiful image including no color slippages. It should be noted that the relations 
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expressed by Eqs. (63) to (65) are also applicable to the RGB gradation values in a uniform manner As a result, by 
creating a transformation table for all gradation values in advance, image data can be transformed at a high speed. 

In the present embodiment, only color slippages in the so-called high-brightness area are taken into consideration. 
This is because, as described earlier, an effect of color slippages in this range can be said to be in conformity with 
reality. As described above, however, since color slippages in the low-brightness area can also be found as well, color 
slippages can be corrected by applying color-slippage quantities obtained for the high-brightness and low-brightness 
areas. Let Dmax be a color-slippage quantity at Ymax and Dmin be a color-slippage quantity at Ymin. In this case, a 
correction quantity D(i) for the component value i is expressed by Eq. (66) as follows: 

D(i) = (Dmax - Dmin) (i - Ymin) / (Ymax - Ymin) + Dmin (66) 



It is needless to say that, with the correction quantity set by the above equation, the parameter used in the com- 
pression equations can be properly adjusted to another value. 

75 Next, the operation of the embodiment having the configuration described above is explained by referring to the 

flowchart shown in Fig. 38 as follows. 

When color slippages are corrected in the digital still camera 12, image data taken by the digital still camera 12 is 
supplied to the computer 21 . At the step S410, a brightness distribution is tabulated for the image data by carrying out 
a predetermined thinning process. When the brightness distribution has been tabulated, a degree of brightness Ymax 

20 is set. As described earlier, the sum of piclu re-element counts for degrees of brightness between Ymax and the highest 
degree of brightness in the brightness range is equal to 0.5% of the total number of all sampled picture elements. The 
flow of processing then goes on to the step S420 at which average values Rav, Gav and Bav for the RGB color com- 
ponents are found. At the following step S430, color slippages DELATR, A G and A B, that is, differences between the 
average values Rav, Gav and Bav and the degree of brightness Ymax, for the RGB color components are found. After 

25 the color slippages A R, A G and A B have been found, the flow of processing continues to the step S440 at which the 
color slippages are compressed and distributed linearly among all gradation values as applied correction quantities to 
be reflected in the image data. 

It is needless to say that, by carrying out the same processing on image data read in through the scanner 11 , color 
slippages generated in the scanner 11 can be corrected. By the same token, such color slippages of an image input 

30 to the video camera 14 can be computed for each scene by taking variations due to hardware aging into consideration 
and used to create a transformation table by supposing that a similar trend exists in the scene and, at the same time, 
image data is transformed for each frame by referring to the transformation table. It is needless to say that, if the 
processing speed is sufficiently high, transformation can be carried out for each plurality of frames and the same 
transformation can also be performed on the receiver side as well. 

35 As described above, in the case of gradation-color-specification data having component values in an all but equal 

relation, in the low-brightness and high-brightness areas, image data represents a white or black color In such an 
area, there is a circumstance wherein component values are regarded as basically equal so that a judgment on a color 
slippage can be made by using a difference in component value. Under such a background, a processing brightness 
of a range where image data does not get saturated is determined at the step S410. an average for each component 

40 value at the processing brightness is calculated at the step S420, a color slippage is calculated as a difference between 
the processing brightness and the average value at the step S430 and the color slippage is reflected in the image data 
at the step S440. 

45 Claims 

1 . An image processing apparatus for carrying out predetermined transformation processing on an input comprising 
component values of image data produced as gradation-color-specification data composed of all but equal color 
components of an image to represent said image as a set of picture elements arranged to form a dot matrix, 
50 producing an output from said transformation processing and carrying out transformation based on a relation be- 

tween said input and said output to correct a balance of color, said image processing apparatus characterized by 
employing a characteristic uniforming means wherein a distribution of said gradation-color-specification data is 
found for each of said color components, a slippage among said color components is recognized and said recog- 
nized slippage is used as a basis for making characteristics uniform among said color components. 



An image processing apparatus according to claim 1 characterized in that said characteristic uniforming means 
treats only picture elements approximated by said gradation-color-specification data for each of said color com- 
ponents as an object for finding said distribution. 
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3. An image processing apparatus according to claim 1 or 2 characterized in that said characteristic uniforming means 
finds sf^id characteristics from predetermined positions at said distributions, computes offset quantities for slip- 
pages among said color components and uses said offset quantities for correction of values of said color compo- 
nents in order to make said characteristics uniform. 

5 

4. An image processing apparatus according to claim 3 characterized in that said characteristic uniforming means 
treats end positions of the range of each of said distributions as a characteristic of said distribution. 

5. An image processing apparatus according to claim 3 characterized in that said characteristic uniforming means 
10 treats a position approximately at the center of the range of each of said distributions as a characteristic of said 

distribution. 

6. An image processing apparatus according to any one of claims 1 to 5 characterized in that said characteristic 
uniforming means makes degrees of spreading of said distributions all but uniform among said color components. 

15 

7. An image processing apparatus according to claim 6 characterized in that said characteristic uniforming means 
increases a degree of spreading of each of said distribution by shifting the ends of said distribution outward over 
an effective gradation range. 

20 8. An image processing apparatus according to claim 6 or 7 characterized in that said characteristic uniforming means 
uses said degrees of spreading of said distributions as a basis for allocating a large number of gradations to a 
range with a high distribution density and allocating a small number of gradations to a range with a low distribution 
density. 

25 9. An image processing apparatus according to any one of claims 1 to 8 characterized in that said characteristic 
uniforming means makes degrees of brightness based on each of said distributions all but uniform among said 
color components. 

10. An image processing apparatus according to claim 9 characterized in that said characteristic uniforming means 
30 forms a judgment as to whether an image is bright or dark by comparing a gradation approximately at the center 

of the range of each of said distributions with a predetermined gradation. 

11. An image processing apparatus according to claim 9 or 10 characterized in that said characteristic uniforming 
means makes degrees of brightness of an image uniform among said color components by carrying out y correction 

35 based on an outcome of said judgment as to whether said image is bright or dark. 

12. An image processing apparatus according to any one of claim 1 to 11 characterized in that said characteristic 
uniforming means includes a correction control means for finding a degree of analogy among said distributions of 
said color components and bypassing said transformation processing in case said degree of analogy has a small 

40 value. 

13. An image processing apparatus according to claim 12 characterized in that said correction control means divides 
a gradation range that said gradation-color-specification data can have, into a plurality of sub-ranges and finds a 
degree of analogy among said color components by comparing partial distributions of a color component with 

45 those of another color component in the same sub-ranges. 

14. An image processing apparatus according to claim 12 or 13 characterized in that said correction control means 
sets a characteristic vector to represent each of said distributions wherein said sub-ranges of said distribution 
represented by said characteristic vector each serve as a member of said characteristic vector representing said 

50 distribution, and finds a degree of analogy among said color components from inner products of said character 

vectors. 

15. An image processing apparatus according to any one of claims 12 to 14 characterized in that said characteristic 
uniforming means provides an effective value for making a decision as to whether or not to make said characteristics 

55 uniform and said correction control means in essence makes a decision as to whether or not to make said char- 

acteristics uniform by varying said effective value and makes said effective value continuously variable. 

16. An image processing apparatus according to claim 1 characterized in that said characteristic uniforming means 
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has a color-slippage computing means for finding a color slippage of said gradation-coior-specification data from 
slippages in value among said color components in low-brightness and high-brightness zones in said gradation- 
color-specification data. 

5 17. An image processing apparatus according to claim 16 characterized in that said color-slippage computing means 
forms a judgment on said color slippage based on a slippage in value among said color components in said high- 
brightness zone. 

18. An image processing apparatus according to claim 16 or 17 characterized in that said color-slippage computing 
10 means forms a judgment on said color slippage by finding a slippage in value among said color components at 

the same degree of brightness. 

19. An image processing apparatus according to any one of claims 16 to 18 characterized in that said color-slippage 
computing means finds a representative value representing said gradation-color-specification data for each of said 

15 color components for a degree of brightness at which a color slippage is found and regards a difference between 

said representative value and said degree of brightness as a color slippage. 

20. An image processing apparatus according to any one of claims 16 to 19 characterized in that said color-slippage 
computing means tabulates a brightness distribution for said gradation -color-specification data and finds a slippage 

20 in value among said color components at a degree of brightness of a point shifted inward from an end of a repro- 

ducible range of said brightness distribution by a distance determined by a predetermined distribution ratio. 

21. An image processing apparatus according to any one of claims 16 to 20 characterized in that said characteristic 
uniforming means has a color-shift correcting means for compressing a detected color slippage and using said 

25 compressed color slippage in correction of a component value. 

22. An image processing apparatus according to claim 21 characterized in that said color-shift correcting means adapts 
a color slippage found at a predetermined gradation for each gradation value and uses said adapted color slippage 
for correction of a component value. 

30 

23. An image processing method for carrying out predetermined transformation processing on an input comprising 
component values of image data produced as an gradation-color-specification data composed of all but equal color 
components of an image to represent said image as a set of picture elements arranged to form a dot matrix, 
producing an output from said transformation processing and carrying out transformation based on a relation be- 

35 tween said input and said output to correct a balance of color, said method characterized by comprising the steps of: 

finding a distribution of said gradation-color-specification data for each of said color components; 
recognizing a slippage among said color components; and 

using said recognized slippage as a basis for making characteristics uniform among said color components. 

40 
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an untrained user to carry out. In addition, the image is 
not correctly compensated for color slippages over the 
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age data including an abnornnal element other than just 
a color slippage, the image can not be corrected with a 
high degree of efficiency. 

At a step S102, a sample-count distribution of im- 
age data is found for each color component by applying 
a thinning technique on samples. At a step S116, a judg- 
ment as to whether or not analogy exists among the 
sample-count distributions of the color components is 
formed. A low degree of analogy is regarded as an in- 
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made uniform among the color components. In this 
case, the characteristics are compensated for a color 
slippage included therein by correcting an offset, putting 
an emphasis on the contrast and correcting the bright- 
ness at steps S204 to S216 in order to produce a well 
pitched and good image from the image data with poor 
color reproducibility. In addition, since the compensation 
and correction work is automated, even an untrained us- 
er is capable of correcting the balance of color with ease. 
Furthermore, at a step S205, an offset quantity reflecting 
a degree of analogy is calculated for use in the compen- 
sation of the characteristics for a color slippage. 
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